fp16 compatibility about awesomemrc

[bhomass]

I read that this is fixed by downgrading pytorch to 1.14.0.
https://github.com/huggingface/transformers/issues/4189

But when I do that, I get a segmenation fault. Nothing is easy.

[bhomass]

I force the n_gpu to be 1, now it crashes with

RuntimeError: CUDA out of memory. Tried to allocate 192.00 MiB (GPU 0; 7.93 GiB total capacity; 7.18 GiB already allocated; 35.94 MiB free; 7.31 GiB reserved in total by PyTorch)

[cooelf]

Yes, it seems to be a version issue that emerges recently. I revised the script according to huggingface/transformers#10199 (comment), and it works for me.

[bhomass]

yes, I got past all these problems, but still ends up with oom, even on colab. I raised a new issue.