Fan Yin

@FlamingoPg · User

GitHub profile ↗ · Compare

Move Faster

Squidward LabSingapore119 followers84 repositories

Repositories

FlamingoPg/sglang

SGLang is a fast serving framework for large language models and vision language models.

★ 1PythonForks 0

FlamingoPg/smg

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

★ 0RustForks 0

FlamingoPg/nsys-ai

Terminal UI for NVIDIA Nsight Systems profiles — timeline viewer, kernel navigator, NVTX hierarchy

★ 0Forks 0

FlamingoPg/FlagGems

FlagGems is an operator library for large language models implemented in Triton Language.

★ 1Forks 0

FlamingoPg/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

★ 0Forks 0

FlamingoPg/Matrix-Game

Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model

★ 0Forks 0

FlamingoPg/website

AGE animation official website URL release page(AGE动漫官网网址发布页)

★ 1Forks 0

FlamingoPg/SpargeAttn

SpargeAttention: A training-free sparse attention that can accelerate any model inference.

★ 0Forks 0