NumberWan

@NumberWan · User

GitHub profile ↗ · Compare

2 followers13 repositories

Repositories

NumberWan/vllm-omni

A framework for efficient model inference with omni-modality models

★ 1PythonForks 0

NumberWan/jiuwenswarm

JiuwenSwarm is an intelligent AI Agent built on openJiuwen. It extends the powerful capabilities of large language models directly to your fingertips through various communication apps you use daily.

★ 0Forks 0

NumberWan/vllm-omni-cookbook

A practical guide to vLLM-Omni with recipes, examples, and best practices for omni-modality inference and serving.

★ 0Forks 0

NumberWan/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0PythonForks 0

NumberWan/router

A high-performance and light-weight router for vLLM large scale deployment

★ 0Forks 0

NumberWan/production-stack

vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

★ 0PythonForks 0