Yao Zengzeng

@YaoZengzeng · User

GitHub profile ↗ · Compare

AI Infra/Service Mesh/Kubernetes Ecosystem/Huaweier/ZJUer/HUSTer

@HuaweiHangzhou China210 followers90 repositories

Repositories

YaoZengzeng/aiperf

AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.

★ 0Forks 0

YaoZengzeng/lws

LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

★ 0Forks 0

YaoZengzeng/kuasar

A multi-sandbox container runtime that provides cloud-native, all-scenario multiple sandbox container solutions.

★ 0Forks 0

YaoZengzeng/foundation

☁️♮🏛 This repo contains several documents related to the operation of the CNCF. File non-technical issues related to CNCF here.

★ 0Forks 0

YaoZengzeng/agent-sandbox

agent-sandbox enables easy management of isolated, stateful, singleton workloads, ideal for use cases like AI agent runtimes.

★ 0Forks 0

YaoZengzeng/sglang

SGLang is a fast serving framework for large language models and vision language models.

★ 0Forks 0

YaoZengzeng/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0Forks 0

YaoZengzeng/aibrix

Cost-efficient and pluggable Infrastructure components for GenAI inference

★ 0Forks 0

YaoZengzeng/litellm

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]

★ 0Forks 0

YaoZengzeng/gateway

Manages Envoy Proxy as a Standalone or Kubernetes-based Application Gateway

★ 0Forks 0

YaoZengzeng/ollama

Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models.

★ 0Forks 0

YaoZengzeng/lingoose

🪿 LinGoose is a Go framework for building awesome AI/LLM applications.

★ 0Forks 0

YaoZengzeng/kmesh

High Performance ServiceMesh Data Plane Based on Programmable Kernel

★ 0GoForks 0

YaoZengzeng/runc

CLI tool for spawning and running containers according to the OCI specification

★ 6GoForks 2

YaoZengzeng/ztunnel

An experimental implementation of the `ztunnel` component of ambient mesh

★ 0RustForks 0

YaoZengzeng/pilot-load

Deploys many lightweight XDS clients to generate load on an XDS server (Pilot)

★ 0GoForks 0