AI Infra & LLM Serving | Kubernetes, Rust, SGLang & vLLM | Building fast, scalable inference systems
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
SGLang is a high-performance serving framework for large language models and multimodal models.
An OpenList Strm tool
Go rules for Bazel
A high-throughput and memory-efficient inference and serving engine for LLMs
Custom Maccy fork with a redesigned clipboard popup and downloadable macOS builds
Lock/unlock your Mac with your iPhone, Apple Watch, or any other Bluetooth LE devices
Demonstration of MobileSAM in the browser enabled through ONNX runtime web
Updated list of public BitTorrent trackers
Use Prometheus to monitor Kubernetes and applications running on Kubernetes
Go Media Framework
《设计数据密集型应用》中文翻译 《Designing Data-Intensive Application》
Spring Data InfluxDB
A command-line tool and Python library and Pytest plugin for automated testing of RESTful APIs, with a simple, concise and flexible YAML-based syntax
Avro support for Spark, SQL, and DataFrames
The Jinja2 template engine
Prometheus for rails and sidekiq
The ultimate Vim configuration: vimrc