Reachable AI for ALL
Repositories
JustinTong0323/sglang
SGLang is a fast serving framework for large language models and vision language models.
JustinTong0323/smg
Shepherd Model Gateway
JustinTong0323/flashinfer
FlashInfer: Kernel Library for LLM Serving
JustinTong0323/Easydict
一个简洁优雅的词典翻译 macOS App。开箱即用，支持离线 OCR 识别，支持有道词典，🍎 苹果系统词典，🍎 苹果系统翻译，OpenAI，Gemini，DeepL，Google，Bing，腾讯，百度，阿里，小牛，彩云和火山翻译。A concise and elegant Dictionary and Translator macOS App for looking up words and translating text.
JustinTong0323/FlashMLA
FlashMLA: Efficient Multi-head Latent Attention Kernels
JustinTong0323/sgl-eval
JustinTong0323/MinerU
Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.
JustinTong0323/mineru-vl-utils
A Python package for interacting with the MinerU Vision-Language Model.
JustinTong0323/AI-Infra-Auto-Driven-SKILLS
JustinTong0323/AReaL
Distributed RL System for LLM Reasoning
JustinTong0323/xgrammar
Fast, Flexible and Portable Structured Generation
JustinTong0323/ome
OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
JustinTong0323/Kimi-Vendor-Verifier
Kimi-Vendor-Verifier
JustinTong0323/edin-mls-26-spring
JustinTong0323/verl
verl: Volcano Engine Reinforcement Learning for LLMs
JustinTong0323/MiniMax-Provider-Verifier
MiniMax-Provider-Verifier offers a rigorous, vendor-agnostic way to verify whether third-party deployments of the Minimax M2 model are correct and reliable.
JustinTong0323/ServerlessLLM
Fast, easy and cost-efficient multi-LLM serving.
JustinTong0323/handson_tutorial
JustinTong0323/owl
🦉 OWL: Optimized Workforce Learning for General Multi-Agent Assistance in Real-World Task Automation
JustinTong0323/camel
🐫 CAMEL: The first and the best multi-agent framework. Finding the Scaling Law of Agents. https://www.camel-ai.org
JustinTong0323/SWE-agent
SWE-agent takes a GitHub issue and tries to automatically fix it, using your LM of choice. It can also be employed for offensive cybersecurity or competitive coding challenges. [NeurIPS 2024]
JustinTong0323/HowToCook
程序员在家做饭方法指南。Programmer's guide about how to cook at home (Simplified Chinese only).
JustinTong0323/slime
slime is a LLM post-training framework aiming at scaling RL.
JustinTong0323/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
JustinTong0323/SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
JustinTong0323/chimera-research
JustinTong0323/gpt-oss
gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI
JustinTong0323/rllm
Democratizing Reinforcement Learning for LLMs
JustinTong0323/kvcached
kvcached: Elastic KV cache for dynamic GPU sharing and efficient multi-LLM inference.