danielvegamyhre/deep-learning-alchemy-assignments
CS312 Deep Learning Alchemy student assignments.
@pytorch
CS312 Deep Learning Alchemy student assignments.
EleutherAI ML Performance reading group repository (slides, meeting recordings, annotated papers)
Distributed cache with client-side consistent hashing, distributed leader-elections, and dynamic node discovery. Supports both REST and gRPC interfaces secured with mTLS.
A web application which detects fake news using machine learning and natural language processing techniques.
Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs
Tensors and Dynamic neural networks in Python with strong GPU acceleration
Staging ground for pytorch/pytorch maintainers to collaborate on release notes for PyTorch releases. Houses the artifacts that chronicle each release.
PyTorch native quantization and sparsity for training and inference
The best ChatGPT that $100 can buy.
A minimal autograd engine and neural network library for machine learning students.
An application to visualize the semantic distance between two words using the Wordnet lexical database and algorithmic path finding.
MSLK (Meta Superintelligence Labs Kernels) is a collection of PyTorch GPU operator libraries that are designed and optimized for GenAI training and inference, such as FP8 row-wise quantization and collective communications.
A decoder-only transformer model implemented from scratch in C++
Development repository for the Triton language and compiler
Triton-based Symmetric Memory operators and examples
A PyTorch native library for large model training
FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
NanoGPT (124M) in 3 minutes
A place to store reusable transformer components of my own creation or found on the interwebs
Production-Grade Container Scheduling and Management
Making encoder-decoder transformers cool again with Differential Attention. English to Spanish translation model.
Kubernetes website and documentation repo:
Llama 2 implemented in Jax