ChuanLi1101/ATOM
AiTer Optimized Model
Repositories
ChuanLi1101/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
ChuanLi1101/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
ChuanLi1101/InferenceMAX
Open Source Continuous Inference Benchmarking - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3- DeepSeek 670B MoE, GPTOSS