ywang96/dynamo
A Datacenter Scale Distributed Inference Serving Framework
Move faster and we will get there
Repositories
ywang96/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
ywang96/deep-swe
Measuring frontier coding agents on original, long-horizon engineering tasks
ywang96/Qwen3-VL
Qwen3-VL is the multimodal large language model series developed by Qwen team, Alibaba Cloud.
ywang96/MiniMax-Provider-Verifier
MiniMax-Provider-Verifier offers a rigorous, vendor-agnostic way to verify whether third-party deployments of the Minimax M2 model are correct and reliable.
ywang96/agentgateway
Next Generation Agentic Proxy for AI Agents and MCP servers
ywang96/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
ywang96/ywang96.github.io
ywang96/ywang96
ywang96/srt-slurm
NVIDIA Inference Benchmarks provide recipes in ready-to-use templates for evaluating platform speed. Validate your platform across specific AI use cases across hardware and software combinations.
ywang96/Kimi-Vendor-Verifier
Kimi-Vendor-Verifier
ywang96/vllm-slurm
srt-slurm but for vllm
ywang96/terminal-bench
A benchmark for LLMs on complicated tasks in the terminal
ywang96/openai-cookbook
Examples and guides for using the OpenAI API
ywang96/MeloTTS
High-quality multi-lingual text-to-speech library by MyShell.ai. Support English, Spanish, French, Chinese, Japanese and Korean.
ywang96/dots.ocr
Multilingual Document Layout Parsing in a Single Vision-Language Model
ywang96/tx
Cross-platform transformer training
ywang96/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
ywang96/chimera-research
ywang96/mistral-evals
ywang96/lmms-eval
Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.
ywang96/Step3
ywang96/open-infra-index
Production-tested AI infrastructure tools for efficient AGI development and community-driven innovation
ywang96/benchmark-single-token
Comparison on Single Token Prediction
ywang96/kubeflow
Machine Learning Toolkit for Kubernetes
ywang96/mistral-common
ywang96/sglang
SGLang is yet another fast serving framework for large language models and vision language models.