runtimeError:Errors in loading state_dict for ChatUniViLlamaForCausalLM about chat-univi

[jpthu17]

Firstly, there is no need to provide mm_projector.bin separately, as the mm_projector weights are already integrated into the model weights (see link).

I suspect this error may stem from incomplete weight downloads. You can try manually downloading the files locally:

pip install -U huggingface_hub
huggingface-cli download --resume-download Chat-UniVi/Chat-UniVi --local-dir ${model path}

then setting the model path as follows:

model_path = ${model path}

[MingfangDeng]

Thank you very much! But I have tried to manualy downloading the files locally, the following is my downloading bin files:

I use the xftp to transfer the bin files to Server, the size of bin files as the same as the local downloading bin files. I have face the same promblem: no such file mm_projector.bin

can you tell me what the problem about this ?

[jpthu17]

Did you set parameter model_base? model_base should be set to None during inference:

model_base = None

[MingfangDeng]

you are right. the model_base should be None. Thank you very much !