yichengj0/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
<3
Repositories
yichengj0/flashinfer
FlashInfer: Kernel Library for LLM Serving
<3
A high-throughput and memory-efficient inference and serving engine for LLMs
FlashInfer: Kernel Library for LLM Serving