output of FastconvMAE about convmae

[stoneMo]

Thanks for your interest in our FastConvMAE. Motivated by the information density in MAE, we fixed the group size to 4. Each group covers 25% of tokens and reconstructs the features of the other 75% features from the other groups. That is, one forward for FastConvMAE is four forwards for the original ConvMAE.

Similarly, if you want to achieve FastMAE, you need carefully check the input (output from the encoder) and mask token for the decoder. Also please check the shape of ids_restore in your implementation. Hope this helps you understand the complementary masking better. The prediction size of the fast version should be [4*bs, 196, 768].

Please feel free to contact us if you have any further questions. If possible, you can open the issue in the FastConvMAE repo, which would be better for later readers.

[lywang76]

Thanks!