PhoGPT-7B5-Instruct has only one word repeated over and over again. about phogpt

[datquocnguyen]

You may want to enable trust-remote-code.

[datquocnguyen]

For the model to work properly, you might need to insert/use the PROMPT template "### Câu hỏi:\n{instruction}\n\n### Trả lời:".

[datquocnguyen]

Closed!
Following the same question from you in this thread: #4
You may want to install pytorch, transformers, and/or run the example code (on Google Colab) with GPU.

[hacbachvotu]

Closed! Following the same question from you in this thread: #4 You might want to install torch, transformers, and/or run the example code (on Google Colab) with GPU.

I have installed all with the latest version and all other models run smoothly except this one.

[datquocnguyen]

#4 (comment)
CUDA_VISIBLE_DEVICES=0 python testscript.py
would generate "Xin chào. Tôi có thể giúp gì cho bạn?".

[hacbachvotu]

#4 (comment) CUDA_VISIBLE_DEVICES=0 python testscript.py would generate "Xin chào. Tôi có thể giúp gì cho bạn?".

sorry i don't know what did you say! i use oobabooga with GPU 12GB 3080ti.

[hacbachvotu]

everything ok when i use another model. I don't understand why only this model of yours is having problems.

[hacbachvotu]

You may want to enable trust-remote-code.

Thanks for you help! It's work with trust-remote-code Flag.

[hacbachvotu]

For the model to work properly, you might need to insert/use the PROMPT template "### Câu hỏi:\n{instruction}\n\n### Trả lời:".

Let me ask one more question: is it correct to put this prompt in oobooga?

[AlexBlack2202]

Câu hỏi:\n{instruction}\n\n### Trả lời:"

For the model to work properly, you might need to insert/use the PROMPT template "### Câu hỏi:\n{instruction}\n\n### Trả lời:".

Let me ask one more question: is it correct to put this prompt in oobooga?

do you know how to correct this?, i have same question