Zhuohan Li

@zhuohan123 ยท User

GitHub profile โ†— ยท Compare

RL and building @vllm-project at Meta | ๐ŸŽ“ cs phd @ ๐ŸŒ uc berkeley | machine learning system | pain is the moat

vLLM / Meta San Francisco Bay Area1,596 followers21 repositories

Repositories

zhuohan123/macaron-net

Codes for "Understanding and Improving Transformer From a Multi-Particle Dynamic System Point of View"

โ˜… 148PythonForks 9

zhuohan123/g2-lstm

Codes for "Towards Binary-Valued Gates for Robust LSTM Training".

โ˜… 75PythonForks 12

zhuohan123/open-infra-index

Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation

โ˜… 1Forks 0

zhuohan123/gloo

Collective communications library with various primitives for multi-machine training.

โ˜… 0Forks 0

zhuohan123/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

โ˜… 0Forks 0

zhuohan123/FlexGen

Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput large-batch generation.

โ˜… 0Forks 0

zhuohan123/DPR

Dense Passage Retriever - is a set of tools and models for open domain Q&A task.

โ˜… 0Forks 0

zhuohan123/ray

A fast and simple framework for building and running distributed applications.

โ˜… 0PythonForks 0

zhuohan123/autodiff

A super tiny CPU single-threaded automated differentiation based on numpy.

โ˜… 2PythonForks 1