elfiegg/Automodel
🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support
Software Engineer
Repositories
elfiegg/cudnn-frontend
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
elfiegg/muon-sharding-bench
Benchmarking Muon Distributed Strategy
elfiegg/ao
PyTorch native quantization and sparsity for training and inference
elfiegg/torchtitan
A PyTorch native platform for training generative AI models
elfiegg/DeepEP
DeepEP: an efficient expert-parallel communication library
elfiegg/flashinfer
FlashInfer: Kernel Library for LLM Serving
elfiegg/sgl-attn
Fast and memory-efficient exact attention
elfiegg/sglang
SGLang is a fast serving framework for large language models and vision language models.
elfiegg/jax
Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
elfiegg/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
elfiegg/xla
A machine learning compiler for GPUs, CPUs, and ML accelerators