afdwang / hetu-galvatron Goto Github PK
View Code? Open in Web Editor NEWGalvatron is an automatic distributed training system designed for Transformer models, including Large Language Models (LLMs). If you have any interests, please visit/star/fork https://github.com/PKU-DAIR/Hetu-Galvatron