ggg-s/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Repositories
ggg-s/dav-c310-forensics
ggg-s/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
ggg-s/sglang-standalone-suffix
ggg-s/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
ggg-s/natively-cluely-ai-assistant
Natively — Free open-source AI meeting assistant, interview copilot, and note taker. The best alternative to Cluely, Otter, Granola, Final Round AI, Fireflies, and Interview Coder. Real-time transcription, AI meeting notes, lecture recording, local RAG, BYOK, and stealth mode. Runs locally. No subscriptions. No data breaches.
ggg-s/llm-compressor
Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
ggg-s/SpecForge
Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
ggg-s/Integrating-Gating-and-Learned-Queries-in-Audiovisual-Emotion-Recognition
ggg-s/Micron-BERT
[CVPR 2023] Micron-BERT: BERT-based Facial Micro-Expression Recognition