SSmallMonster/ContextStor
Tiered shared KV cache storage for LLM inference. Extends GPU HBM to host memory, NVMe, and JBOF pools — enabling cross-instance prefix reuse for vLLM, Dynamo, and NIXL.
Maintainer and Architect of HwameiStor
Tiered shared KV cache storage for LLM inference. Extends GPU HBM to host memory, NVMe, and JBOF pools — enabling cross-instance prefix reuse for vLLM, Dynamo, and NIXL.
Supercharge Your LLM with the Fastest KV Cache Layer
A high-throughput and memory-efficient inference and serving engine for LLMs
Scripts that make daily work more efficient!
Prometheus exporter for use with the Lustre parallel filesystem
Lustre Monitoring System
Kubectl plugin for effortless profiling on kubernetes
很多镜像都在国外。比如 gcr 。国内下载很慢,需要加速。
Tools to helping hwameistor cluster healthy.
Provides deploy scripts and CSI for Lustre.
Mirror of official Lustre development repository http://git.whamcloud.com/
Machine Learning Engineering Open Book
Delta intercepts data and divert it to different storage directories.
MIT课程《Distributed Systems 》学习和翻译
Samples for testing GPU Direct Storage(GDS), including DALI, RAPIDS frameworks.
12 weeks, 26 lessons, 52 quizzes, classic Machine Learning for all
A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.
A user-space file system for interacting with Google Cloud Storage
A simple, high-throughput file client for mounting an Amazon S3 bucket as a local file system.
WFS File Storage System
Slides of CLK2023, Shenzhen
Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)
Hwameistor is an HA local storage system for cloud-native stateful workloads.