mard1no Goto Github PK

nanopyc

nccl-tests

NCCL Tests

note

nvidia_sgemm_practice

Step-by-step optimization of CUDA SGEMM

oneflow

OneFlow is a performance-centered and open-source deep learning framework.

oneflow-lite

oneshotallreduceexample

open-resume

OpenResume is a powerful open-source resume builder and resume parser. https://open-resume.com/

openmlsys-cuda

Tutorials for writing high-performance GPU operators in AI frameworks.

paddle

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

paddleclas

A treasure chest for visual classification and recognition powered by PaddlePaddle

paddlefleetx

Paddle Distributed Training Examples. 飞桨分布式训练示例 Resnet Bert GPT MOE DataParallel ModelParallel PipelineParallel HybridParallel AutoParallel Zero Sharding Recompute GradientMerge Offload AMP DGC LocalSGD Wide&Deep

paddlenlp

👑 Easy-to-use and powerful NLP library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis and 🖼 Diffusion AICG system etc.

paper_reading

powersgd

Practical low-rank gradient compression for distributed optimization: https://arxiv.org/abs/1905.13727

ppl.kernel.cuda

ptx-isa

CUDA PTX-ISA Document 中文翻译版

pytorch

Tensors and Dynamic neural networks in Python with strong GPU acceleration

qsync

Official resporitory for "QSync: Adpative Mixed-Precision for Training Synchronization".

quickmathhpp

a single-header math library

redpajama-data

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

taichi-hackathon-akinasan

Akinasan team（秋名山车队）'s code base for the 0th Taichi Hackathon.

taichi-nerfs

Implementations of NeRF variants based on Taichi + PyTorch

tensorflow-internals

It is open source ebook about TensorFlow kernel and implementation mechanism.

tensorrt

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

tiktoken

tools

Collect some useful code.

triton

Development repository for the Triton language and compiler

tutorial-multi-gpu

Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial

typst

A new markup-based typesetting system that is powerful and easy to learn.