ISEEKYAN/mbridge
Bridge Megatron-Core to Hugging Face/Reinforcement Learning
Bridge Megatron-Core to Hugging Face/Reinforcement Learning
Ongoing research training transformer models at scale
A high-throughput and memory-efficient inference and serving engine for LLMs
A set of examples based on verl for end-to-end RL training recipes.
verl: Volcano Engine Reinforcement Learning for LLMs
FlashMLA: Efficient Multi-head Latent Attention Kernels
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
DeepEP: an efficient expert-parallel communication library
(best/better) practices of megatron on veRL and tuning guide
Training library for Megatron-based models
Megatron Lite support for moonshotai/Kimi-K3 (KDA + gated MLA hybrid attention, LatentMoE, MXFP4 weights) — external model integration example
Standalone Tencent Hy3 support for Megatron-Lite — reference example of external model integration via register_model()
Miles is an enterprise-facing reinforcement learning framework for LLM and VLM post-training, forked from and co-evolving with slime.
An LLM post-training framework with vLLM for RL Scaling
slime is an LLM post-training framework for RL Scaling.
Best practices for testing advanced Mixtral, DeepSeek, and Qwen series MoE models using Megatron Core MoE.
Fast Diffusion Models with Transformers