yiliu30 Goto Github PK

accelerate

🚀 A simple way to train and use PyTorch models with multi-GPU, TPU, mixed-precision

ai-research

ao

The torchao repository contains api's and workflows for quantization and pruning gpu models.

auto-round

SOTA Weight-only Quantization Algorithm for LLMs

awesome-model-quantization

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

baidu-allreduce

brecq

Pytorch implementation of BRECQ, ICLR 2021

brpc

brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Machine learning, Advertisement, Recommendation etc. "brpc" means "better RPC".

codexglue

CodeXGLUE

cs344

Introduction to Parallel Programming class code

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

dist_tuto.pth

Official code for "Writing Distributed Applications with PyTorch", PyTorch Tutorial

examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

extension-cpp

C++ extensions in PyTorch

former

Simple transformer implementation from scratch in pytorch.

gemma.cpp

lightweight, standalone C++ inference engine for Google's Gemma models.

hawq

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

hqq

Official implementation of Half-Quadratic Quantization (HQQ)

intel-extension-for-transformers

⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡

leveldb

LevelDB is a fast key-value storage library written at Google that provides an ordered mapping from string keys to string values.

machine-learning-collection

A resource for learning about Machine learning & Deep Learning

mpi-operator

Kubernetes Operator for MPI-based applications (distributed training, HPC, etc.)

mpitutorial

MPI programming lessons in C and executable code examples

neural-compressor

Intel® Neural Compressor (formerly known as Intel® Low Precision Optimization Tool), targeting to provide unified APIs for network compression technologies, such as low precision quantization, sparsity, pruning, knowledge distillation, across different deep learning frameworks to pursue optimal inference performance.

nlp-tutorial

Natural Language Processing Tutorial for Deep Learning Researchers

nni

An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.

onednn

oneAPI Deep Neural Network Library (oneDNN)

onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

optimum-habana

Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

optimum-intel

🤗 Optimum Intel: Accelerate inference with Intel optimization tools