mard1no Goto Github PK

ai-system

System for AI Education Resource.

aitemplate

AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

awesome-gpu

Awesome resources for GPUs

awesome-llm-system-papers

awesome-system-for-machine-learning

A curated list of research in machine learning systems (MLSys). Paper notes are also provided.

baidu-allreduce

bytetransformer

optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052

cachelib

Pluggable in-process caching engine to build and scale high performance services

cmake-examples

Useful CMake Examples

concurrencyinaction

cpp-concurrency-in-action-2ed

C++11/14/17/20 multithreading, involving operating system principles and concurrent programming technology.

cuassembler

An unofficial cuda assembler, for all generations of SASS, hopefully ：）

cublas-test

cuda-samples

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

cuda-training-series

Training materials associated with NVIDIA's CUDA Training Series (www.olcf.ornl.gov/cuda-training-series/)

cudalibrarysamples

CUDA Library Samples

cutlass_master

CUDA Templates for Linear Algebra Subroutines

cv-cuda

CV-CUDA™ is an open-source, graphics processing unit (GPU)-accelerated library for cloud-scale image processing and computer vision.

data

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

datastruct

deeprec

DeepRec is a recommendation engine based on TensorFlow.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

designpattern

C++11全套设计模式-23种指针的用法(a full DesignPattern implement with c++11)

di-engine

OpenDILab Decision AI Engine

dockerfiles

docs

Documentations for PaddlePaddle

ece408

edgegpt

Reverse engineered API of Microsoft's Bing Chat AI

fairring

Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large scales

fastertransformer

Transformer related optimization, including BERT, GPT