HAI

@HaiShaw · User

GitHub profile ↗ · Compare

San Francisco98 followers36 repositories

Repositories

HaiShaw/sglang

SGLang is a fast serving framework for large language models and vision language models.

★ 3PythonForks 2

HaiShaw/tilelang

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

★ 0Forks 0

HaiShaw/ossci-fleet

The goal of the OSSCI Fleet is to provide a central mechanism to enable test automation, batch job scheduling, and developer access to a federated set of limited GPU resources

★ 1PowerShellForks 1

HaiShaw/microxcaling

PyTorch emulation library for Microscaling (MX)-compatible data formats

★ 0Forks 0

HaiShaw/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0PythonForks 0

HaiShaw/minGPT

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

★ 2PythonForks 1

HaiShaw/FBGEMM

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/

★ 0C++Forks 0