Repositories
dskhudia/cutlass
CUDA Templates for Linear Algebra Subroutines
dskhudia/megablocks
dskhudia/llmperf
LLMPerf is a library for validating and benchmarking LLMs
dskhudia/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
dskhudia/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
dskhudia/mosaic-examples
Fast and flexible reference benchmarks
dskhudia/llm-foundry
LLM training code for MosaicML foundation models
dskhudia/FasterTransformer
Transformer related optimization, including BERT, GPT
dskhudia/composer
library of algorithms to speed up neural network training
dskhudia/ffcv
FFCV: Fast Forward Computer Vision (and other ML workloads!)
dskhudia/glow
Compiler for Neural Network hardware accelerators
dskhudia/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
dskhudia/pytext
A natural language modeling framework based on PyTorch
dskhudia/FBGEMM
FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/
dskhudia/fbshipit
Copy commits between repositories - git => git, git => hg, hg => hg, or hg => git