GaoYusong/llm.cpp
A C++ port of karpathy/llm.c features a tiny torch library while maintaining overall simplicity.
Building large-scale AI inference systems at Ant Group. Previously built production systems for PolarDB and Alibaba Cloud RDS.
Repositories
GaoYusong/sglang
SGLang is a fast serving framework for large language models and vision language models.
GaoYusong/GaoYusong
GaoYusong/tokenspeed
TokenSpeed is a speed-of-light LLM inference engine.
GaoYusong/aiconfigurator
Offline optimization of your disaggregated Dynamo graph
GaoYusong/FlashQLA
high-performance linear attention kernel library built on TileLang
GaoYusong/TileRT
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
GaoYusong/DeepGEMM
DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
GaoYusong/myduckserver
Unified MySQL, Postgres & FlightSQL Server, Powered by DuckDB.
GaoYusong/minillm
GaoYusong/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
GaoYusong/gaoyusong.github.io
GaoYusong/nano-qwen25
GaoYusong/filter
A lightweight IP filter library inspired by pcap-filter
GaoYusong/go-mysql-server
A MySQL-compatible relational database with a storage agnostic query engine. Implemented in pure Go.
GaoYusong/duckdb
DuckDB is an analytical in-process SQL database management system
GaoYusong/llm.c
LLM training in simple, raw C/CUDA
GaoYusong/erlang-traffic-control
A traffic control library written in Erlang uses the token bucket algorithm to manage the rate of flow.
GaoYusong/erlang-request-simulation
A tool for request simulation written in Erlang can simulate numerous connection requests and precisely control the send rate for each connection.
GaoYusong/innodb_python
a python tool to parse innodb on-disk structure, and i want to make it as a python version tool like innodb_ruby by Jeremy Cole (https://github.com/jeremycole)
GaoYusong/llama_index_starter_pack
This repository provides very basic flask, streamlit, and docker examples for the llama_index (fka gpt_index) package
GaoYusong/FPPinScala
exercise of Functional Programming Principles in Scala in coursera.org
GaoYusong/Automata
Programming Assignments of Automata in coursera.org
GaoYusong/Compilers
solution of project in compilers course from stanford, implement a compiler for Cool programming language
GaoYusong/join-order-benchmark
Join Order Benchmark (JOB)
GaoYusong/benchmark_ipfilter
cidr ip filter algorithm (hash and trie) implemented by cpp and erlang