yuan-luo/sglang
SGLang is a fast serving framework for large language models and vision language models.
Repositories
yuan-luo/flashinfer
FlashInfer: Kernel Library for LLM Serving
yuan-luo/cuLA
CUDA kernels for linear attention variants, written in CuTe DSL and CUTLASS C++.
yuan-luo/sglang-omni
SGLang Omni: High-Performance Multi-Stage Pipeline Framework for Omni Models
yuan-luo/funny_cute
Some funny cute/cuteDSL code snippets
yuan-luo/flash-linear-attention
🚀 Efficient implementations of state-of-the-art linear attention models
yuan-luo/hpc-ops
High Performance LLM Inference Operator Library
yuan-luo/verl
verl: Volcano Engine Reinforcement Learning for LLMs
yuan-luo/LeetCode
yuan-luo/likewise-open
Likewise OSS project
yuan-luo/DeepGEMM
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
yuan-luo/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.
yuan-luo/triton
Development repository for the Triton language and compiler
yuan-luo/SageAttention
Quantized Attention achieves speedup of 2-5x and 3-11x compared to FlashAttention and xformers, without lossing end-to-end metrics across language, image, and video models.
yuan-luo/FlashMLA
FlashMLA: Efficient MLA decoding kernels
yuan-luo/DeepLearningSystem
Deep Learning System core principles introduction.
yuan-luo/Awesome-Cute
yuan-luo/learning_cute
some easy examples for cutlass and cute
yuan-luo/cute-gemm
yuan-luo/DeepEP
DeepEP: an efficient expert-parallel communication library
yuan-luo/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
yuan-luo/FasterTransformer
Transformer related optimization, including BERT, GPT
yuan-luo/3FS
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
yuan-luo/Pre-training-language-model
博客配套视频链接: https://space.bilibili.com/383551518?spm_id_from=333.1007.0.0 b 站直接看 配套 github 链接：https://github.com/nickchen121/Pre-training-language-model 配套博客链接：https://www.cnblogs.com/nickchen121/p/15105048.html
yuan-luo/async_simple
Simple, light-weight and easy-to-use asynchronous components
yuan-luo/rdmapp
C++ interfaces for RDMA access
yuan-luo/yuan-luo.github.io
yuan-luo/rdma-core
RDMA core userspace libraries and daemons
yuan-luo/learn-python3
Learn Python 3 Sample Code
yuan-luo/oceanbase
OceanBase is an enterprise distributed relational database with high availability, high performance, horizontal scalability, and compatibility with SQL standards.