Rui Wang

@RuiWang1998 · User

GitHub profile ↗ · Compare

@HeliXonProtein 39 followers12 repositories

Repositories

RuiWang1998/DeepGEMM

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

★ 0Forks 0

RuiWang1998/TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.

★ 0PythonForks 0

RuiWang1998/longhorn

Official PyTorch Implementation of the Longhorn Deep State Space Model

★ 0Forks 0

RuiWang1998/apex

A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

★ 0PythonForks 0

RuiWang1998/bigscience

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

★ 0Forks 0

RuiWang1998/examples

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

★ 0Forks 0