Somoku/psrl
An Efficient Asynchronous RL Framework for LLM Post-Training
MSc @ PKU | Systems for LLM
Repositories
Somoku/smg
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, SGLang, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.
Somoku/PKUElective2022Spring
PKUAutoElective for 2022 spring semester
Somoku/somoku.github.io
My personal profile.
Somoku/nixl
NVIDIA Inference Xfer Library (NIXL)
Somoku/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Somoku/NeMo
A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
Somoku/Hetu_doc
Somoku/Hetu
A high-performance distributed deep learning system targeting large-scale and automated distributed training.
Somoku/CMU10-714-DLSys
My self-learning materials for CMU 10-714 (Fall 2022).
Somoku/SysY-Compiler
Compiler from SysY to RISC-V for course Compiler Principles.
Somoku/router
Router running DV algorithm and supporting NAT function for Computer Networking Lab3.
Somoku/myftp
A simplified FTP implementation for Computer Networking Lab1.
Somoku/switch
Implementation of a simplified Switch for Computer Networking Lab4.
Somoku/rtp
Implementation of RTP based on UDP for Computer Networking Lab2.
Somoku/boki-benchmarks
Benchmark workloads of Boki
Somoku/spright
Somoku/boki
Boki: Stateful Serverless Computing with Shared Logs [SOSP '21]
Somoku/Somoku
Config files for my GitHub profile.