Myasuka/llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
Focus on multimodal distributed computations, also an apache Flink committer.
Achieve state of the art inference performance with modern accelerators on Kubernetes
Orchestrate multiple coding agents from desktop and mobile
llm-d Router: The intelligent entry point for inference requests
A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.
Open source Ghostty-based macOS terminal with vertical tabs and notifications for AI coding agents. Built for multitasking, organization, and programmability.
WeChat 4.0 database decryptor - extract keys from memory, decrypt SQLCipher 4 databases, real-time message monitor
Ray is a unified framework for scaling AI and Python applications. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
This library provides an implementation of the DBSP language for incremental streaming computations.
LLM驱动的 A/H/美股智能分析:多数据源行情 + 实时新闻 + LLM决策仪表盘 + 多渠道推送,零成本定时运行,纯白嫖. LLM-powered stock analysis system for A/H/US markets.
The best ChatGPT that $100 can buy.
A Datacenter Scale Distributed Inference Serving Framework
A Local-first chat analysis tool: Relive your social memories powered by SQL and AI Agents. 本地化的聊天记录分析工具,通过 SQL 和 AI Agent 回顾你的社交记忆。
Cost-efficient and pluggable Infrastructure components for GenAI inference
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
No longer maintained, see pinned issues
A high-throughput and memory-efficient inference and serving engine for LLMs
FULL Augment Code, Claude Code, Cluely, CodeBuddy, Comet, Cursor, Devin AI, Junie, Kiro, Leap.new, Lovable, Manus, NotionAI, Orchids.app, Perplexity, Poke, Qoder, Replit, Same.dev, Trae, Traycer AI, VSCode Agent, Warp.dev, Windsurf, Xcode, Z.ai Code, Dia & v0. (And other Open Sourced) System Prompts, Internal Tools & AI Models
🐸 Read Frog - Open Source Immersive Translate | 🐸 陪读蛙 - 开源沉浸式翻译
Let's experience immersive web translation, with bilingual simultaneous display and translation of only the important content. Think of the browser's reading mode, but in immersive translation.
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
A toolkit to run Ray applications on Kubernetes
My personal site
BigDL: Distributed Deep Learning Library for Apache Spark
Apache Flink connector for ElasticSearch
Apache PyIceberg
Feldera Continuous Analytics Platform
An Apache Flink subproject to provide storage for dynamic tables.
Apache Flink Training Excercises
Apache Celeborn is an elastic and high-performance service for shuffle and spilled data.
Playground for Flink Table Store with use cases and performance features