Levi080513

@Levi080513 · User

GitHub profile ↗ · Compare

1 followers12 repositories

Repositories

Levi080513/production-stack

vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

★ 0PythonForks 0

Levi080513/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0Forks 0

Levi080513/ray

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

★ 0Forks 0

Levi080513/utils

Non-Kubernetes-specific utility libraries which are consumed by multiple projects.

★ 0Forks 0