Zhichenzzz/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
SGLang is a high-performance serving framework for large language models and multimodal models.
USTC Computational Physics A Homework
Allow torch tensor memory to be released and resumed later
The source of LMSYS website and blogs
Terminal-Bench-Science: Evaluating AI Agents on Complex Real-World Scientific Workflows in the Terminal
🐬 A blue and pastels theme inspired by Palenight. This theme was especially designed to provide more syntax highlighting for python 🐍
An independent Python feature port of Claude Code, entirely rewritting from scratch using oh-my-codex. Educational Purpose only.
PNCEL Website
🚧 Accepting Task Submissions 🚧
Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.
verl: Volcano Engine Reinforcement Learning for LLMs
SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]
Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
[ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
SWE-bench: Can Language Models Resolve Real-world Github Issues?
🙌 OpenHands: Code Less, Make More
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
Triton kernels for sparse attention
The UW SAMPL group's website.
SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
an educational compiler intermediate representation
A scalable High-Level Synthesis framework on MLIR
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving
Allo DSL
A schedule language for large model training
The LLVM Project is a collection of modular and reusable compiler and toolchain technologies. Note: the repository does not accept github pull requests at this moment. Please submit your patches at http://reviews.llvm.org.