How to visualize the warped image (ref_img_wapred) about sfmlearner-pytorch

[huhaoyue]

I want to visualize the reconstructed images by warping, but I can't write related scripts. I really hope can get your help. I saw the same issue in the previous problem, but he provided the test_warp.py is no relevant content after I download it.

[ClementPinard]

Hi,
the warped images are actually part of the output from photometric reconstruction loss

SfmLearner-Pytorch/loss_functions.py

Line 9 in 9640fbb

def photometric_reconstruction_loss(tgt_img, ref_imgs, intrinsics,

And as you can see during training, it is transformed into tensorboard within this line of code : https://github.com/ClementPinard/SfmLearner-Pytorch/blob/master/train.py#L311

As such, to visualize it you can simply run the training with the option --log-output and --training-output-freq set to a certain number N, to get vizualisations on tensorboard, it will output a new image with target, warped and diff every N batch (corresponding to the first image of the batch)

Or you can run photometric reconstruction loss function and then try to modify the function log output tensorboard to get the image and save it in jpg instead of tensorboard format.

SfmLearner-Pytorch/utils.py

Line 69 in 9640fbb

def log_output_tensorboard(writer, prefix, index, suffix, n_iter, depth, disp, warped, diff, mask):