Woody-Hu/llama.cpp
LLM inference in C/C++
2018-2025 Architect (Principal Software Engineer II) for @seismic 2025-2026 AI & Agent Solution Architect for bedicloud contributor for @infiniflow
LLM inference in C/C++
TokenSpeed is a speed-of-light LLM inference engine.
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
SGLang is a high-performance serving framework for large language models and multimodal models.
Acceptance-driven adaptive verification for speculative decoding: verify/skip/probe controller, routable draft pool, plugin registry.
solution to help you improve deepseek harness SSE and workspace management
A free, open-source, universal document viewer for the web. Render PDF, PPTX, and images with high fidelity — no server required.
Rapid orchestration for multi‑harness systems
useful skills
Universal memory layer for AI Agents
SkillRL: Evolving Agents via Recursive Skill-Augmented Reinforcement Learning
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
Official inference framework for 1-bit LLMs
Community-maintained LangChain integrations
🦜🔗 The platform for reliable agents.
Python bindings for llama.cpp
An End-to-End Infrastructure for Training and Evaluating Various LLM Agents
RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.
The open source coding agent.
Public repository for Agent Skills
A set of ready to use scientific skills for Claude
Chrome MCP Server is a Chrome extension-based Model Context Protocol (MCP) server that exposes your Chrome browser functionality to AI assistants like Claude, enabling complex browser automation, content analysis, and semantic search.
Browser automation for AI agents and humans