YeonwooSung/torchtitan
A PyTorch native platform for training generative AI models
As I've always been
A PyTorch native platform for training generative AI models
Implementing LLM architectures from scratch in PyTorch
cuda-oxide is a Rust-to-CUDA compiler that lets you write (SIMT) GPU kernels in safe(ish), idiomatic Rust. It compiles standard Rust code directly to PTX — no DSLs, no foreign language bindings, just Rust.
One Postgres for your application data, full-text search, vector retrieval, and aggregations. Home of the pg_search extension.
Powerful coding agent
serving LLMs on micro GPUs
Miscellaneous codes and writings for MLOps
verl: Volcano Engine Reinforcement Learning for LLMs
slime is an LLM post-training framework for RL Scaling.
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
Rust-based video analysis toolkit
A high-throughput and memory-efficient inference and serving engine for LLMs
A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
Ongoing research training transformer models at scale
Datasets, Transforms and Models specific to Computer Vision
Rust-based alternative for kafka
Train transformer language models with reinforcement learning.
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
PostgreSQL High-Availability Cluster (based on "Patroni" and DCS "etcd" or "consul"). Automating with Ansible.
Vitess for Postgres
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Tensors and Dynamic neural networks in Python with strong GPU acceleration
PyTorch implementation of GNN models
List of skills that I used for my Agents
PyTorch implementation of LIMoE
PyTorch implementation of moe, which stands for mixture of experts