rasbt/LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

★ 106,733Forks 16,432Jupyter NotebookGitHub ↗Compare

Project website ↗

ai artificial-intelligence attention-mechanism deep-learning finetuning from-scratch generative-ai gpt instruction-tuning language-model large-language-models llm machine-learning natural-language-processing pretraining python pytorch tokenizer transformers

Contributors

Issues