chmxu / ett_tmlr2022 Goto Github PK

will the training code for this model be released?

Hello! Thank you for releasing your outstanding work! While using your code, I have a small question: In your paper, you emphasized the importance of the initial prefix, and you adopted the initialization method of the attentive prototype. However, the implementation in your code seems to be simply averaging all patch embeddings from each category. I wonder if there is a comparable performance between the two approaches? It appears that you provide a simpler option in your code.

There is a bug in the example code loading a pre-trained ViT model.
Code Line
The argument should be "model.ckpt" instead of "data.ckpt".
This bug got introduced in commit "update doc"/2f15355

Hi, I am very interested in your work. When I attempted to reproduce the model provided in #1 using the default settings in your code, I achieved an accuracy of 75.27% on Omniglot and 76.77% on Aircraft. This shows a notable difference from the results mentioned in your paper (78.11% and 79.94%). Could you please help me identify if there are any details I might have overlooked?

hello, it's a fantastic work which achieve a ViT-applied adapter. It can expand adapter method from Resnet to ViT-like network. Could you provide some suggestions on how to choose a good learning rate with adam/adamw? Also, I wanna know how the hyperparameters in code you get. Appreciate your efforts on it.

Hello.
Could you please upload the finetuning code that was used for the support data. Also, I would like to implement this with SWIN_VIT. Could you give a brief methodology on what changes have to be made at model level, ie. how to implement DRA in the layers.

Thanks.

The DINO Pretrain used in this experiment is primary different from official dino by 1000 classes VS 712 classes?
And why do such a setting? It's clear that the main target of this paper is cross-domain application, so use full ImageNet dataset don't affect the result. Maybe this is for compare with other method like TSA and CTX?
Looking forward to your reply! Thanks!

Hello. Could you please provide the training commands for reproduction ? Thanks a lot