zejunchen-zejun/aiter
AI Tensor Engine for ROCm
AMD员工,凯瑞大厦B2上班,B2不是地下室
AI Tensor Engine for ROCm
Open Source Continuous Inference Benchmark Research Platform — Kimi K3 2.8T, MiniMax M3, DeepSeekv4, GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 & soon™ TPUv6e/v7/Trainium2/3 | 开源持续推理基准研究平台 — Kimi K2.7-Code、MiniMax M3、DeepSeekv4、GLM5 - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72,即将推出™ TPUv6e/v7/Trainium2/3
SGLang is a fast serving framework for large language models and vision language models.
AiTer Optimized Model
Self-contained GPU kernel profiler for ROCm. Zero roctracer/rocprofiler-sdk dependency. HSA-only interception, SQLite trace output, Perfetto compatible.
A high-throughput and memory-efficient inference and serving engine for LLMs
A framework for efficient model inference with omni-modality models
Supercharge Your LLM with the Fastest KV Cache Layer
Tensors and Dynamic neural networks in Python with strong GPU acceleration