Levi080513/production-stack
vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization
A high-throughput and memory-efficient inference and serving engine for LLMs
Cloud native networking and network security
Home for Cluster API, a subproject of sig-cluster-lifecycle
The UI of neutree
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
Go client for Kubernetes.
Non-Kubernetes-specific utility libraries which are consumed by multiple projects.
NVIDIA GPU metrics exporter for Prometheus leveraging DCGM
A repository to host extended examples and tutorials