Image order RGB or BRG? about deeplab-v2--resnet-101--tensorflow

[zhengyang-wang]

For deeplab pre-trained models, I believe the order of image channels is BGR.
I provide the pre-trained resnet models from TF Slim, where the means should not be divided by 255.
https://github.com/tensorflow/models/blob/master/research/slim/preprocessing/vgg_preprocessing.py
And you are right about the order. If resnet pre-trained models are used, the order should be changed back to RGB. A one-line change is enough.

[zhengyang-wang]

But actually I don't think it is crucial. In this task, the size of training patches is also different from that in resnet. And the set of images is different. Maybe simply using image_mean=[127.5, 127.5, 127.5] will work well.

[John1231983]

Agree. I have tested with difference IMAGE_MEAN and it has no much performance diffference. Could I ask ome more question about pretrained model? When you use resnet pretrained model, it means that you will copy pretrained weight of resnet to encoder part of deeplab network. Then we will train the decoder part. But I found that you also trained the encoder part after copy weight from resnet model. Why did not only train the decoder part? Thanks

[zhengyang-wang]

This is because the set of images changes. It is true that they are all natural images with similar features so that transfer learning is feasible here. However, images in PASCAL or CITYSCAPES do not appear in ImageNet. Thus, we'd like to fine-tune the encoder to let it fit the new set of images. Actually, we use the pre-trained models in order to make sure the training converge, as the number of images in PASCAL or CITYSCAPES is much smaller than that in ImageNet.

[John1231983]

I see. So it looks like we use pretrain model to have a good weight initialization. Then retrain the model with the good weight. Am I right?

[zhengyang-wang]

Yes.