size mismatch for opt_proj.weight: copying a param with shape torch.Size([2560, 768]) from checkpoint, the shape in current model is torch.Size([768, 768]). about lavis

[HeYiyang2]

I also want to know

[HeYiyang2]

please,bro

[shaonian526-526]

I also want to know,too!!

[zrj1234212]

同求解决方法

[rhyhck]

同求解决办法

[rhyhck]

How should this problem be solved? Thank you!

How should this problem be solved? Thank you!

Hi, friend. Have you resolved the problem? I need help~

[harukaza]

I solved the problem by using the local opt_model opt-2.7b in the blip2_pretrain_opt2.7b.yaml , which come from Facebook/opt-2.7b.

[harukaza]

In fact, I misunderstand the different usages between huggingface and the project page. The former provides a whole ckpt, while the latter need two different module ckpts (i.e., blip2_pretrained_opt2.7b.pth & opt-2.7b)