Exception: Failed to init class <class 'tools.modules.clip_embedder.FrozenOpenCLIPTtxtVisualEmbedder'>, with Pretrained weights (models/open_clip_pytorch_model.bin) not found for model ViT-H-14. about vgen

[LJ-lijian]

I got the same error, did someone solve this problem?

[Steven-SWZhang]

Have you placed the downloaded models in the "models" directory?

[sayakpaul]

It still happens. My models directory has:

doc                          README.md  stable_diffusion_image_key_temporal_attention_x1.json
i2vgen_xl_00854500.pth       README.MD  v2-1_512-ema-pruned.ckpt
open_clip_pytorch_model.bin  source

Now, when I run:

python inference.py --cfg configs/i2vgen_xl_infer.yaml

It results in the error.

[himali94]

Same error
Exception: Failed to init class <class 'tools.modules.clip_embedder.FrozenOpenCLIPTtxtVisualEmbedder'>, with Model config for VIT-H-14 not found.

[wuguowuge]

I got the same error +1, did someone solve this problem?

[zhenglinpan]

I cloned original ViT-H-14 from huggingface which provides both model & config file, merged with model folder, looked fine tho.

Hope repository owner make this clear.