yuezhu1/spyre-inference
vLLM plugin for Spyre based on torch-spyre
Repositories
yuezhu1/torch-spyre
yuezhu1/interface-specs
Documents describing interfaces between compiler/runtime and device
yuezhu1/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
yuezhu1/semantic-router
Intelligent Router for Mixture-of-Models
yuezhu1/LMBenchmark
Systematic and comprehensive benchmarks for LLM systems.
yuezhu1/LMCache
Supercharge Your LLM with the Fastest KV Cache Layer
yuezhu1/octopus
A RDMA-enabled Distributed Persistent Memory File System
yuezhu1/cruise
User space POSIX-like file system in main memory
yuezhu1/models
Models and examples built with TensorFlow
yuezhu1/tensorflow
Computation using data flow graphs for scalable machine learning