YAMY

YAMY1234/sglang

SGLang is a fast serving framework for large language models and vision language models.

YAMY1234/NewBloomSpa

YAMY1234/llm-arch-reviewer

Interactive architecture diagrams for LLM inference, with profile data overlaid (DeepSeek-V4, ...)

YAMY1234/agent-orchestrator-public

A visual, durable command center for running, resuming, and monitoring multiple terminal coding agents.

YAMY1234/sgl-eval

YAMY1234/YAMY1234.github.io

YAMY1234/dynamo

A Datacenter Scale Distributed Inference Serving Framework

YAMY1234/aiperf

AIPerf is a comprehensive benchmarking tool that measures the performance of generative AI models served by your preferred inference solution.

YAMY1234/CorMulT

YAMY1234/InferenceX

Open Source Continuous Inference Benchmarking Qwen3.5, DeepSeek, GPTOSS - GB200 NVL72 vs MI355X vs B200 vs GB300 NVL72 vs H100 & soon™ TPUv6e/v7/Trainium2/3

YAMY1234/srt-slurm-upstream

NVIDIA Inference Benchmarks provide recipes in ready-to-use templates for evaluating platform speed. Validate your platform across specific AI use cases across hardware and software combinations.

YAMY1234/srt-slurm

Collection of SLURM deployment scripts for various hardware + sglang disaggregation variants

YAMY1234/TorchSpec

A PyTorch native library for training speculative decoding models

YAMY1234/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

YAMY1234/terminal-bench

A benchmark for LLMs on complicated tasks in the terminal

YAMY1234/lm-sys.github.io

The source of LMSYS website and blogs

YAMY1234/TensorRT-LLM

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.

YAMY1234/prism-research

Research prototype of PRISM — a cost-efficient multi-LLM serving system with flexible time- and space-based GPU sharing.

YAMY1234/sgl-runner

YAMY1234/LongBench

LongBench v2 and LongBench (ACL 25'&24')

YAMY1234/flashinfer

FlashInfer: Kernel Library for LLM Serving

YAMY1234/FlashMLA

FlashMLA: Efficient Multi-head Latent Attention Kernels

YAMY1234/AI4App

An AI based platform that can automatically integrate application requirements from all official websites

YAMY1234/FusionTree

YAMY1234/screen-share

YAMY1234/Awesome-ML-SYS-Tutorial

My learning notes/codes for ML SYS.

YAMY1234/LLM_DYSAT

YAMY1234/chatGPTAutomationControl

YAMY1234/Mips-54-cpu

Coursework of Computer Architecture at Tongji University

YAMY1234/PlugginEvaluationPlatform