Building AI Inference & GPU Clusters @MooreThreads AI | Cloud Native | Virtualization | macOS/iOS - ex @sangfor / @vmware
Repositories
yeahdongcn/llama.cpp
LLM inference in C/C++
yeahdongcn/sglang-omni
SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.
yeahdongcn/sglang
SGLang is a fast serving framework for large language models and vision language models.
yeahdongcn/vllm-musa
yeahdongcn/nautilus-studio
AI-native long-form video studio with hidden storyboard orchestration and pluggable generation backends.
yeahdongcn/agentman
Agentman: A tool for building and managing AI agents
yeahdongcn/tmux-codex-auto-continue
Safely resumes interrupted Codex CLI turns and selected retry/wait states from tmux.
yeahdongcn/duo-grab
yeahdongcn/flashinfer
FlashInfer: Kernel Library for LLM Serving
yeahdongcn/RSBarcodes
1D and 2D barcodes scanner and generators for iOS7 with delightful controls.
yeahdongcn/CocoaControlsPlugin
OS X native application with Xcode plugin for browsing, searching, integrating, cloning controls in http://cocoacontrols.com/.
yeahdongcn/SGLang-Desktop
yeahdongcn/mate
MUSA AI Tensor Engine
yeahdongcn/FastVideo
A unified inference and post-training framework for accelerated video generation.
yeahdongcn/RSTransitionEffect
Re-implement mayuur's MJTransitionEffect(https://github.com/mayuur/MJTransitionEffect) and provide default data binding for UITableViewCell and detail view controller and solve the white screen problem. All images, data source are taken from mayuur's MJTransitionEffect.
yeahdongcn/UIColor-Hex-Swift
Convenience methods for creating color using RGBA hex string.
yeahdongcn/vllm-omni
A framework for efficient model inference with omni-modality models
yeahdongcn/awesome-codex-cli
A curated list of awesome resources, tools, and tutorials for OpenAI Codex CLI
yeahdongcn/list
A list of tmux plugins.
yeahdongcn/awesome-tmux
A list of awesome resources for tmux
yeahdongcn/RSBarcodes_Swift
1D and 2D barcodes reader and generators for iOS 8 with delightful controls. Now Swift.
yeahdongcn/night-city-pixel
Pixel-art cyberpunk action RPG in pure vanilla JS — collect iron, buy chrome, own the streets. Zero deps, all art & music procedural, moddable, AI-agent-friendly. Unofficial fan tribute.
yeahdongcn/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
yeahdongcn/TileRT
Tile-Based Runtime for Ultra-Low-Latency LLM Inference
yeahdongcn/LightLLM
LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.
yeahdongcn/LightX2V
Light Video Generation Inference Framework
yeahdongcn/fauxpilot
FauxPilot - an open-source alternative to GitHub Copilot server
yeahdongcn/server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
yeahdongcn/apple-smi
The familiar nvidia-smi experience for Apple Silicon: High-performance, sudoless GPU monitoring with zero dependencies.