AuFlow/sglang-omni
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
A framework for efficient model inference with omni-modality models
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
SGLang is a high-performance serving framework for large language models and multimodal models.