zhongbozhu/Megatron-LM
Ongoing research training transformer models at scale
DevTech @ NVIDIA | Ex Amazon | MS CompE @ UIUC | ZJUer
Repositories
zhongbozhu/cudnn-frontend
cuDNN Frontend is NVIDIA's modern, open-source entry point to the cuDNN library and a growing collection of high-performance open-source kernels.
zhongbozhu/TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
zhongbozhu/Megatron-Bridge
Training library for Megatron-based models with bidirectional Hugging Face conversion capability
zhongbozhu/mixture-of-kittens
Mixture-of-experts (MoE) training megakernel for NVL72s
zhongbozhu/RL
Scalable toolkit for efficient model reinforcement
zhongbozhu/Megatron-Energon
Megatron's multi-modal data loader
zhongbozhu/DeepEP
DeepEP: an efficient expert-parallel communication library
zhongbozhu/CornellBox
Online Course GAMES101 Assignment7: Path Tracing Algorithm Implemented with Multi-thread Acceleration
zhongbozhu/sample-kube-backend
zhongbozhu/LearnOpenGL
zhongbozhu/HarmoniOS
HarmoniOS - tiny Linux-like OS kernel
zhongbozhu/Simulate-TCP-by-UDP
Simulate TCP reliable data transfer with UDP
zhongbozhu/fun-with-mmap
mmap for file access && mmap for IPC
zhongbozhu/CUDA-Acceleration-Conv
zhongbozhu/ECE508-report-graphs
zhongbozhu/cuda-ldbc-graph-analytics-docker
zhongbozhu/hadoop
Apache Hadoop
zhongbozhu/Hadoop-setup-scripts
zhongbozhu/Raft-Consensus-Java
Raft consensus implementation using Java, tested in framework based on python asyncio
zhongbozhu/nodejs-python-named-pipe
learning inter-process communication using pipes between nodejs and python
zhongbozhu/Leetcode-Cpp
zhongbozhu/Leetcode-Python
zhongbozhu/Deploy-Quora-Question-Pair-Model
deploy the quora question pair model to web app
zhongbozhu/ECE449_Quora_Question_Pair
zhongbozhu/zzb66666666x.github.io
zhongbozhu/Leetcode-Java-Practice
zhongbozhu/JavaLearning
zhongbozhu/fputs-cpp-module-for-py
code for wrap fputs in C to a python module using python.h and distutils
zhongbozhu/LeetCode
This repository contains the solutions and explanations to the algorithm problems on LeetCode. Only medium or above are included. All are written in C++/Python and implemented by myself. The problems attempted multiple times are labelled with hyperlinks.