This is a simpler implementation of GPT-NeoX in PyTorch. We have taken out several optimizations in GPT-NeoX for simplicity.
dataandai / neox Goto Github PK
View Code? Open in Web Editor NEWThis project forked from labmlai/neox
Simple Annotated implementation of GPT-NeoX in PyTorch
Home Page: https://lit.labml.ai/github/labmlai/neox/tree/main/src/neox/__init__.py
License: MIT License