simon-mo/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
cofounder of @Inferact, lead maintainer of @vllm-project
Repositories
simon-mo/tar-rs
Tar file reading/writing for Rust
simon-mo/pr-review-bot
simon-mo/vLLM-Benchmark
simon-mo/simon-mo
simon-mo/release-notes-writing
simon-mo/s3s
S3 Service Adapter
simon-mo/gpt-oss
gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI
simon-mo/green-ctx
simon-mo/triton
Development repository for the Triton language and compiler
simon-mo/vllm-community-dashboard
simon-mo/vllm-flash-attention
Fast and memory-efficient exact attention
simon-mo/vllm-landing-page
simon-mo/FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
simon-mo/flashinfer
FlashInfer: Kernel Library for LLM Serving
simon-mo/DeepSeek-V3
simon-mo/sp24
simon-mo/conex
Container Express is a tool to accelerate Docker push and pull.
simon-mo/megablocks
simon-mo/nanoGPT
The simplest, fastest repository for training/finetuning medium-sized GPTs.
simon-mo/better-gh-inbox
simon-mo/model-loader
simon-mo/inferline-models
simon-mo/torchmuxer
simon-mo/sky-container
simon-mo/sky-uploader
simon-mo/sky-packer
simon-mo/Azurite
A lightweight server clone of Azure Storage that simulates most of the commands supported by it with minimal dependencies
simon-mo/azure-sdk-for-rust
This repository is for active development of the *unofficial* Azure SDK for Rust. This repository is *not* supported by the Azure SDK team.