zanderjiang/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
@cmu-catalyst
Repositories
zanderjiang/SkyRL
SkyRL: A Modular Full-stack RL Library for LLMs
zanderjiang/verl
verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework
zanderjiang/slime
slime is an LLM post-training framework for RL Scaling.
zanderjiang/SkyRL-IsoExec
zanderjiang/zanderjiang.github.io
Github Pages template based upon HTML and Markdown for personal, portfolio-based websites.
zanderjiang/vllm-project.github.io
zanderjiang/sglang
SGLang is a fast serving framework for large language models and vision language models.
zanderjiang/Megatron-LM-olmo
zanderjiang/mini-sglang
A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.
zanderjiang/llmsys_hw7
CMU Large Language Model Systems HW7
zanderjiang/llmsys_hw6
CMU Large Language Model Systems HW6
zanderjiang/ThunderAgent
A simple, fast and robust program-aware agentic inference system.
zanderjiang/OpenHands
🙌 OpenHands: AI-Driven Development
zanderjiang/claude-code-system-prompts
All parts of Claude Code's system prompt, 24 builtin tool descriptions, sub agent prompts (Plan/Explore/Task), utility prompts (CLAUDE.md, compact, statusline, magic docs, WebFetch, Bash cmd, security review, agent creation). Updated for each Claude Code version.
zanderjiang/claude-code
Claude Code's Source Code & Breakdown from a leaked map file in their NPM registry
zanderjiang/SWE-agent
SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]
zanderjiang/mini-swe-agent
The 100 line AI agent that solves GitHub issues or helps you in your command line. Radically simple, no huge configs, no giant monorepo—but scores >74% on SWE-bench verified!
zanderjiang/flashinfer-bench-dev
Building the Virtuous Cycle for AI-driven LLM Systems
zanderjiang/kernelbot
Write a fast kernel and see how you compare against the best humans and AI on gpumode.com
zanderjiang/gpumode-popcorn-kernels
Official Problem Sets / Reference Kernels for the GPU MODE Leaderboard!
zanderjiang/rlm
General plug-and-play inference library for Recursive Language Models (RLMs), supporting various sandboxes.
zanderjiang/llmsys_hw3
CMU Large Language Model Systems HW3
zanderjiang/llmsys_hw2
CMU Large Language Model Systems HW2
zanderjiang/KernelBench
KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems
zanderjiang/tilelang
Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels
zanderjiang/robust-kbench
zanderjiang/xgrammar
Efficient, Flexible and Portable Structured Generation
zanderjiang/BackendBench
How to ship your LLM generated kernels to PyTorch
zanderjiang/flashinfer
FlashInfer: Kernel Library for LLM Serving