Zheyu Shen

@shenzheyu · User

GitHub profile ↗ · Compare

UMD ECE PhD student.

University of Maryland, College ParkCollege Park, MD 2074012 followers36 repositories

Repositories

shenzheyu/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0PythonForks 0

shenzheyu/NanoLLM

Optimized local inference for LLMs with HuggingFace-like APIs for quantization, vision/language models, multimodal agents, speech, vector DB, and RAG.

★ 0PythonForks 0

shenzheyu/sglang

SGLang is a fast serving framework for large language models and vision language models.

★ 0PythonForks 0

shenzheyu/transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

★ 0Forks 0

shenzheyu/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

★ 1PythonForks 0

shenzheyu/RSA

用该代码生成一对公钥和私钥,并用私钥加密一段明文“Today is a nice day”。

★ 11C++Forks 2

shenzheyu/CS61B

Data Structure & Algorithm (UCB, spring 2018)

★ 21JavaForks 1

shenzheyu/CS61C

CS 61C at UC Berkeley with Stephan Kaminsky, Sean Farhat, Jenny Song - Summer 2020

★ 2CForks 0

shenzheyu/CUDAMasterclass

Code base for CUDA Masterclass course (udemy.com/course/cuda-programming-masterclass)

★ 1CudaForks 0