Accuracy of non-iNat Networks about prototree

[M-Nauta]

These results can simply be explained by the fact that freezing and unfreezing was only implemented for ResNet50 and not for other architectures (my bad). That’s why the other backbones gave such a bad accuracy. The non-pretrained weights of the model (1x1 conv layer and prototypes) need to settle in a bit before finetuning the backbone. I have updated the code such that every network first trains the add-on layer and prototypes for a few epochs, before unfreezing and training the whole model. Secondly, since the backbone is pretrained on a task which is further away from the target task (not iNat but ImageNet for bird recognition), it makes sense to increase the learning rates of the backbone. I didn’t do any hyperparameter tuning, but something like
python3 main_tree.py --epochs 150 --log_dir ./runs/protoree_cub --dataset CUB-200-2011 --lr 0.001 --lr_block 0.002 --lr_net 1e-4 --num_features 256 --depth 9 --net resnet50 --freeze_epochs 2 --milestones 60,80,100,120,140
should work much better than reported before (I got 71% for ResNet50 and 54% for VGG16). The results will probably not match the iNat-initialization, since CUB-200-2011 is a very small dataset and therefore susceptible to good weight initializations which wasn’t the core focus for now.

[EoinKenny]

Thanks a lot M-Nauta!