The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
A new primitive in AI. Callable expertise in the cloud — not a file you download, a function you call.
An open-source database of AI models.
markdown docs
AI inference insights by Prashanth—exploring InferX’s 4-second cold starts and 80%+ GPU utilization for enterprises and cloud users needing easy deployment.
InferX is a Inference Function as a Service Platform