tingshua-yts Goto Github PK

adaptdl

Resource-adaptive cluster scheduler for deep learning training.

angular-6wh5ma

Created with StackBlitz ⚡️

annotated-transformer

An annotated implementation of the Transformer paper.

ant-design

An enterprise-class UI design language and React UI library

arena

A CLI for Kubeflow.

baichuan-13b

A 13B large language model developed by Baichuan Intelligent Technology

baichuan-7b

A large-scale 7B pretraining language model developed by BaiChuan-Inc.

betterdl

betterserver

bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

client-go

Go client for Kubernetes.

cnn-text-classification-tf

Convolutional Neural Network for Text Classification in Tensorflow

controller-runtime

Repo for the controller-runtime subproject of kubebuilder (sig-apimachinery)

dali

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

deepspeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

deepspeedexamples

Example models using DeepSpeed

djl-serving

A universal scalable machine learning model deployment solution

dlrover

DLRover: An Automatic Distributed Deep Learning System

et-operator

Kubernetes Operator for AI and Bigdata Elastic Training

fastertransformer

Transformer related optimization, including BERT, GPT

fastertransformer_backend

fluid

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)

gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

gpushare-device-plugin

GPU Sharing Device Plugin for Kubernetes Cluster

horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

huggingface-transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

k8s-device-plugin

NVIDIA device plugin for Kubernetes

k8s-rdma-device-plugin

RDMA device plugin for Kubernetes

kube-queue

kubedl

Run your deep learning workloads on Kubernetes more easily and efficiently.