[BUG] macOS mps not support although configured with accelerate config about autotrain-advanced

[magusCoder-official]

I think Mac OS does'nt support fp16 nor bf 16. Can you try using docker probably that might help.

[abhishekkrthakur]

seems like a transformers issue: huggingface/transformers#29431

[abhishekkrthakur]

autotrain llm \
--train \
--model gpt2 \
--data-path timdettmers/openassistant-guanaco \
--lr 2e-4 \
--batch-size 2 \
--epochs 1 \
--trainer sft \
--peft \
--project-name ms-re-1

seems to be working fine.