AichenF/sglang
SGLang is a fast serving framework for large language models and vision language models.
Repositories
AichenF/humming
Humming is a high-performance, lightweight, and highly flexible JIT (Just-In-Time) compiled GEMM kernel library specifically designed for quantized inference.
AichenF/flashinfer
FlashInfer: Kernel Library for LLM Serving
AichenF/DeepGEMM
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
AichenF/verl-recipe
A set of examples based on verl for end-to-end RL training recipes.
AichenF/TileGym
Helpful kernel tutorials and examples for tile-based GPU programming