vaibtan Goto Github PK

annotated_deep_learning_paper_implementations

🧑‍🏫 60 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, ... 🧠

attorch

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

automemcpy

cse511_ca_project

RISCV RV32i Simulator and Assembler

ctypeslib

Generate python ctypes classes from C headers. Requires LLVM clang

cuda-lectures

Material for cuda-mode lectures

deeperspeed

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

distributed-database-with-raft-consensus-algorithm

Implemented a database storing string key-value pairs using Raft Consensus Algorithm, ensuring consistent data replication and fault recovery across the distributed network of nodes. Obtained Linearizable Reads without paying high latency penalties for each request by utilizing the leader lease mechanism.

enterprise-level-food-ordering-platform

A full stack website for an app which lets users order delicacies from various cuisines, with features including user authentication, registration, profile management; sort, filter, pagination for search results page; cart management, stripe payment checkout and real-time order status.

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

haskell-mooc

My solutions to the problems sets of Haskell MOOC offered by the University of Helsinki

libcoders-compression-lib

File compression library | Shennon | Fano | Huffman | Bigram Huffman | Adaptive Huffman | Arithmetic coding

linear-optimization-simplex-algorithm

Implementation of the Simplex Algorithm without degenerated case

llama.cpp

LLM inference in C/C++

llama2.c

Inference Llama 2 in one file of pure C

llm

An ecosystem of Rust libraries for working with large language models

llm.c

LLM training in simple, raw C/CUDA

llms-from-scratch

Implementing a ChatGPT-like LLM from scratch, step by step

lockfree

A collection of lock-free data structures written in standard C++11

minimal-byte-pair-encoding-implementation

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

multimodal-transformer

[ACL'19] [PyTorch] Multimodal Transformer

nanogpt

The simplest, fastest repository for training/finetuning medium-sized GPTs.

opencv

Open Source Computer Vision Library

py-algo-lib

⚡ Competitive Programming Library

pykan

Kolmogorov Arnold Networks

pythia

A customizable hardware prefetching framework using online reinforcement learning as described in the MICRO 2021 paper by Bera et al. (https://arxiv.org/pdf/2109.12021.pdf).

python-patterns

Source code behind the python-patterns.guide site by Brandon Rhodes

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

rwkv-lm

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.