Jun Liu

@StarDuster · User

GitHub profile ↗ · Compare

AI and System Learner.

ApodexTokyo, Japan165 followers27 repositories

Repositories

StarDuster/sglang

SGLang is a fast serving framework for large language models and vision language models.

★ 0PythonForks 0

StarDuster/smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

★ 0RustForks 0

StarDuster/sglang-omni

SGLang Omni: High-Performance Multi-Stage Pipeline Framework for Omni Models

★ 0Forks 0

StarDuster/genai-bench

Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.

★ 0PythonForks 0

StarDuster/DeepGEMM

DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

★ 0Forks 0

StarDuster/gem5-bc

A fork of gem5 computer-system architecture simulator with burst counter (bc).

★ 1C++Forks 0

StarDuster/DIVA-Loader

DIVA Loader lets you load plugins into Hatsune Miku Project DIVA Arcade Future Tone by placing them into the "plugins" folder.

★ 1C++Forks 0