vMaroon/llm-d-router
Inference scheduler for llm-d
@llm-d core maintainer
Repositories
vMaroon/ATOM
AiTer Optimized Model
vMaroon/llm-d.github.io
Website for llm-d: This repository builds the website seen at llm-d.ai
vMaroon/revue
Stage your PR review before it goes public.
vMaroon/praxis
AI and cloud-native proxy server and framework
vMaroon/gpu-reaper
vMaroon/llm-d-inference-payload-processor
Inference payload processor for llm-d
vMaroon/codex
Lightweight coding agent that runs in your terminal
vMaroon/coordinator
vMaroon/llm-d
Achieve state of the art inference performance with modern accelerators on Kubernetes
vMaroon/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
vMaroon/clawdchan
Let my Claude talk to yours.
vMaroon/gateway-api-inference-extension
Gateway API Inference Extension
vMaroon/llm-d-kv-cache
Distributed KV cache scheduling & offloading libraries
vMaroon/sideye
A personal PR-review extension.
vMaroon/inference-perf
GenAI inference performance benchmarking tool
vMaroon/api-gateway-sipur
vMaroon/api-gateway
vMaroon/llm-d-benchmark
llm-d benchmark scripts and tooling
vMaroon/hello-chris-llm-d
A variety of instructions and demos for setting up
vMaroon/llm-d-infra
llm-d helm charts and deployment examples
vMaroon/llm-d-modelservice
vMaroon/LMCache
Redis for LLMs
vMaroon/production-stack
Scale from single vLLM instance to distributed vLLM deployment without changing any application code.
vMaroon/aibrix
Cost-efficient and pluggable Infrastructure components for GenAI inference
vMaroon/langchaingo
LangChain for Go, the easiest way to write LLM-based programs in Go
vMaroon/kubestellar
KubeStellar - a flexible solution for challenges associated with multi-cluster configuration management for edge, multi-cloud, and hybrid cloud
vMaroon/corp
Agent-Agnostic K8s based infrastructure
vMaroon/kubestellar-workload-stager
A Kubernetes application that utilizes Kubestellar mechanisms for multi-cluster workload staged placement.
vMaroon/ocm-status-addon
Status add-on for Open Cluster Management transport