mingming.zhou

@SSmallMonster · User

GitHub profile ↗ · Compare

Maintainer and Architect of HwameiStor

DaoCloudShanghai16 followers83 repositories

Repositories

SSmallMonster/ContextStor

Tiered shared KV cache storage for LLM inference. Extends GPU HBM to host memory, NVMe, and JBOF pools — enabling cross-instance prefix reuse for vLLM, Dynamo, and NIXL.

★ 0Forks 0

SSmallMonster/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0Forks 0

SSmallMonster/Delta

Delta intercepts data and divert it to different storage directories.

★ 0CForks 0

SSmallMonster/examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

★ 0Forks 0

SSmallMonster/fluid

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)

★ 0Forks 0