youkaichao/youkaichao
github profile
Ph.D. from Tsinghua University. Core maintainer of @vllm-project . Co-Founder & Chief Scientist @Inferact .
github profile
A high-throughput and memory-efficient inference and serving engine for LLMs
minimal database
A dockerfile to build my portable environment for AI/ML development, with some daily used packags!
FlashInfer: Kernel Library for LLM Serving
OneNote导出成Markdown文件的脚本
NVIDIA Inference Xfer Library (NIXL)
A hello-world usage for frame eval api.
test images with not appropriate labels in MNIST dataset
fast bpe tokenizer, simple to understand, easy to use
List recently available pytorch nightly version, for every day
Tensors and Dynamic neural networks in Python with strong GPU acceleration
ftp-project for the network course
An extremely fast Python package and project manager, written in Rust.
Perplexity GPU Kernels
WheelNext Website
DeepEP: an efficient expert-parallel communication library
OpenMMLab Foundational Library for Training Deep Learning Models
Software Engineering 2018 project, collegiate contest platform
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
A dictionary that allows attribute-style access, for py 312
Example models using DeepSpeed