Converting MATLAB trained model .mat files (off the shelf and trained on Pittsburg 30k) in Pytorch about netvlad

[Relja]

Hi,

Sorry but I don't have hands on experience with this and haven't used PyTorch.

Few suggestions:

• There's this tool I know about: https://github.com/albanie/pytorch-mcn and they have already imported NetVLAD apparently.
• This is really more of a question MatConvNet->PyTorch than NetVLAD specific (though you also need to implement the NetVLAD layer which is custom here), so you can try asking the MatConvNet people.
• Maybe going through tensorflow as I imagine tf -> PyTorch could be more standard. I know this project which apparently imported NetVLAD checkpoints to tf: https://github.com/uzh-rpg/netvlad_tf_open
• You should be able to load the .mat file from the opensource and free Octave, so you could use that to 1) export weights in whatever format you want, or 2) double check the imported weights match tha ones in the mat files.

I guess things that could be problematic beyond just importing weights is if there are some slight differences in implementation across frameworks, e.g. maybe there are some tiny padding issues, or I recall reading about some nets being extremely sensitive to the exact method used when resizing images etc.