carmocca/core
:house_with_garden: Open source home automation that puts local control and privacy first.
Research Engineer
Repositories
carmocca/pytorch
Tensors and Dynamic neural networks in Python with strong GPU acceleration
carmocca/ao
PyTorch native quantization and sparsity for training and inference
carmocca/neptune-fetcher
Neptune Fetcher is designed to separate data retrieval capabilities from the regular neptune package. This separation makes data fetching more efficient and improves performance.
carmocca/DeepSpeed
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
carmocca/PyLaia-examples
A set of experiments using PyLaia on different datasets
carmocca/flogging
Logging module with nicer formatting
carmocca/torchtitan
A native PyTorch Library for large model training
carmocca/litgpt
Pretrain, finetune, deploy 20+ LLMs on your own data. Uses state-of-the-art techniques: flash attention, FSDP, 4-bit, LoRA, and more.
carmocca/toolbox
Essential guides and programming tools in my toolbox (with focus on ML Training)
carmocca/fp8-benchmark
carmocca/litdata
Blazingly fast, distributed streaming of training data from any cloud storage for training AI models
carmocca/lightning-thunder
Source to source compiler for PyTorch. It makes PyTorch programs faster on single accelerators and distributed.
carmocca/lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
carmocca/Fuser
A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
carmocca/neurips_llm_efficiency_challenge
NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
carmocca/TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper GPUs, to provide better performance with lower memory utilization in both training and inference.
carmocca/faster-pytorch-blog
Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
carmocca/xla
Enabling PyTorch on Google TPU
carmocca/DALI
A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.
carmocca/UVA
UVA programming challenges
carmocca/probot
carmocca/lightning-quick-start
carmocca/lightning
Build and train PyTorch models and connect them to the ML lifecycle using Lightning App templates, without handling DIY infrastructure, cost management, scaling, and other headaches.
carmocca/stable-diffusion
A latent text-to-image diffusion model
carmocca/taming-transformers
Taming Transformers for High-Resolution Image Synthesis
carmocca/Megatron-LM
Ongoing research training transformer models at scale
carmocca/ffcv
FFCV: Fast Forward Computer Vision (and other ML workloads!)
carmocca/AdventOfCode2016
My java solutions of the programming puzzles.
carmocca/nnutils
CPU & CUDA implementation of several neural network utils