William Song

@song-william · User

GitHub profile ↗ · Compare

3 followers20 repositories

Repositories

song-william/ray

Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

★ 0Forks 0

song-william/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0Forks 0

song-william/Speculative-Sampling

Implementation of Speculative Sampling as described in "Accelerating Large Language Model Decoding with Speculative Sampling" by Deepmind

★ 0Forks 0

song-william/kinetics-i3d

Convolutional neural network model for video classification trained on the Kinetics dataset.

★ 0Jupyter NotebookForks 0