shifangx/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Repositories
shifangx/sglang
SGLang is a fast serving framework for large language models and vision language models.
shifangx/Megatron-LM
Ongoing research training transformer models at scale
shifangx/slime
slime is an LLM post-training framework for RL Scaling.
shifangx/Megatron-Bridge
Training library for Megatron-based models with bidirectional Hugging Face conversion capability
shifangx/torch-cudagraph-debug
CUDA Graph runtime tensor debugging utilities for PyTorch
shifangx/Scripts-SGLang
shifangx/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
shifangx/SteptronOss
A lightweight, AI-native training framework for large language models. Designed for fast iteration, reproducible experiments, and modular configuration across SFT, RLVR, and evaluation workflows.
shifangx/AReaL
The RL Bridge for LLM-based Agent Applications. Made Simple & Flexible.
shifangx/InfraTech
分享AI Infra知识&代码练习：PyTorch/vLLM/SGLang框架入门⚡️、性能加速🚀、大模型基础🧠、AI软硬件🔧等
shifangx/RL
Scalable toolkit for efficient model reinforcement
shifangx/verl
verl: Volcano Engine Reinforcement Learning for LLMs
shifangx/claude-code
An independent Python feature port of Claude Code, entirely rewritting from scratch using oh-my-codex. Educational Purpose only.
shifangx/mbridge
Bridge Megatron-Core to Hugging Face/Reinforcement Learning
shifangx/ml-engineering
Machine Learning Engineering Open Book
shifangx/TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.
shifangx/ProfileData_HybridEP
shifangx/VeOmni
VeOmni: Scaling Any Modality Model Training with Model-Centric Distributed Recipe Zoo
shifangx/DeepEP
DeepEP: an efficient expert-parallel communication library
shifangx/paper-reading
深度学习经典、新论文逐段精读
shifangx/dynamo
A Datacenter Scale Distributed Inference Serving Framework
shifangx/flashinfer
FlashInfer: Kernel Library for LLM Serving
shifangx/AIInfra
AIInfra（AI 基础设施）指AI系统从底层芯片等硬件，到上层软件栈支持AI大模型训练和推理。
shifangx/DualPipe
A bidirectional pipeline parallelism algorithm for computation-communication overlap in V3/R1 training.
shifangx/python3-pygame-icehappy
利用Python3和Pygame开发的一款桌面端消消乐游戏。A desktop elimination game developed using Python3 and Pygame.