ZhengGong-amd/aiter
AI Tensor Engine for ROCm
AI agent engineer.
AI Tensor Engine for ROCm
SGLang is a high-performance serving framework for large language models and multimodal models.
AiTer Optimized Model
A high-throughput and memory-efficient inference and serving engine for LLMs
Open Source Continuous Inference Benchmark Research Platform Kimi K2.6, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3