Intelligence-Manifesto/AISystem
AISystem 主要是指AI系统,包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
AISystem 主要是指AI系统,包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术
Hackable implementation of state-of-the-art open-source LLMs based on nanoGPT. Supports flash attention, 4-bit and 8-bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.
The simplest, fastest repository for training/finetuning medium-sized GPTs.
Implementing a ChatGPT-like LLM from scratch, step by step
🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo
Optimized primitives for collective multi-GPU communication
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Code for the paper "Language Models are Unsupervised Multitask Learners"
主要记录大语言大模型(LLMs) 算法(应用)工程师相关的知识及面试题
Phi2-Chinese-0.2B 从0开始训练自己的Phi2中文小模型,支持接入langchain加载本地知识库做检索增强生成RAG。Training your own Phi2 small chat model from scratch.
12 Lessons, Get Started Building with Generative AI 🔗 https://microsoft.github.io/generative-ai-for-beginners/