yhl-amd/ATOM
AiTer Optimized Model
Repositories
yhl-amd/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
yhl-amd/InferenceX
Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72，即将推出™ TPUv6e/v7/Trainium2/3
yhl-amd/aiter
AI Tensor Engine for ROCm
yhl-amd/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs