Fridge003/Fridge003.github.io
My personal website
Novice of Building Systems
Repositories
Fridge003/Cuda-Learn-By-Practice
Codebase for Cuda Learning
Fridge003/lm-sys.github.io
Fridge003/Fridge003
Fridge003/nvidia-srt-slurm
NVIDIA Inference Benchmarks provide recipes in ready-to-use templates for evaluating platform speed. Validate your platform across specific AI use cases across hardware and software combinations.
Fridge003/sgl-eval
Fridge003/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Fridge003/sglang-dev-tools
My set of tools for SGLang development
Fridge003/sgl-DeepGEMM
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
Fridge003/srt-slurm
Benchmark SGLang on SLURM
Fridge003/assignment5-alignment
Fridge003/assignment4-data
Fridge003/assignment3-scaling
Fridge003/assignment2-systems
Student version of Assignment 2 for Stanford CS336 - Language Modeling From Scratch
Fridge003/assignment1-basics
Student version of Assignment 1 for Stanford CS336 - Language Modeling From Scratch
Fridge003/lm-evaluation-harness
A framework for few-shot evaluation of language models.
Fridge003/FlashMLA
FlashMLA: Efficient Multi-head Latent Attention Kernels
Fridge003/srtlog
Simple log -> parquet converting and visualizer for SGLang benchmarking runs
Fridge003/sgl-cookbook
Cookbook of SGLang - Recipe
Fridge003/sgl-flash-attn
Fast and memory-efficient exact attention
Fridge003/dynamo
A Datacenter Scale Distributed Inference Serving Framework
Fridge003/whl
Kernel Library Wheel for SGLang
Fridge003/LongBench
LongBench v2 and LongBench (ACL 25'&24')
Fridge003/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.
Fridge003/MIT-6.824
My repository storing codes and notes for MIT 6.824 Distributed Systems course.
Fridge003/llmops-chatgpt-huggingface
Fridge003/Paddle
Baidu Paddle Paddle
Fridge003/LLaMA-Factory
Easy-to-use LLM fine-tuning framework (LLaMA, BLOOM, Mistral, Baichuan, Qwen, ChatGLM)
Fridge003/klavx
wechat server for pkupiano
Fridge003/SoundLib
A website of pkupiano, allowing members upload their own recordings