(Google Colab) ImportError: cannot import name '_expand_mask' from 'transformers.models.bloom.modeling_bloom' about phogpt

[datquocnguyen]

It's a mismatch with the latest version of transformers. You might want to use an older version of transformers (e.g., 4.33).

I will make a fix to work with the latest version of transformers soon.

[datquocnguyen]

@phatjkk code updated, please help check whether it works fine in your side with the latest transformers.

[kxgong]

check

Hi, I met this problem with 4.36.0/1/2. I update my transformers to use mixtral-8x7b.

How can I solve this issue. Thank you.

[kxgong]

@phatjkk code updated, please help check whether it works fine in your side with the latest transformers.

My older version is 4.31.0 and it was no problem.

[megiandoni]

Also have this issue with 4.36.2

[datquocnguyen]

Please clear your cache of PhoGPT, and re-download it.
https://huggingface.co/vinai/PhoGPT-7B5-Instruct/blob/main/hf_prefixlm_converter.py was updated without any bloom modeling.

[kxgong]

Please clear your cache of PhoGPT, and re-download it. https://huggingface.co/vinai/PhoGPT-7B5-Instruct/blob/main/hf_prefixlm_converter.py was updated without any bloom modeling.

Thank you, I will try this.