rootfs/ai-gateway
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
Inventor | Inspirer | Influencer. Creator of vLLM Semantic Router, Kepler Project, MicroShift, etc | Kubernetes SIG-Storage Founding Member
Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.
Log-structured Caching for Linux
MCP server for unified code, script, and operational dependency graph localization
Work with remote images registries - retrieving information, images, signing content
Copilot Chat extension for VS Code
containerized NFS Ganesha daemon
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
Easy Data Preparation with latest LLMs-based Operators and Pipelines.
Bringing BERT into modernity via both architecture changes and scaling
Intelligent Mixture-of-Models Router for Efficient LLM Inference
mirror of git://git.samba.org/ctdb.git
vLLM Gateway Router
LLM Semantic Router: Intelligent Mixture-of-Models (MoM) System with Privacy Preservation and Prompt Guard. The semantic router intelligently directs OpenAI compliant API requests to the most suitable backend models based on semantic understanding of request content.
Describes Gardener components for installation of a Gardener landscape using sow
Redis for LLMs
Scale from single vLLM instance to distributed vLLM deployment without changing any application code.
NGINX and NGINX Plus Ingress Controllers for Kubernetes
Kepler (Kubernetes-based Efficient Power Level Exporter) uses eBPF to probe energy related system stats and exports as Prometheus metrics
Kubernetes integration for OVN
Ceph RADOS API for Hadoop
Kubernetes CephFS PV Provisioner