virgil-at-biocompute

@virgil-at-biocompute · User

GitHub profile ↗ · Compare

1 followers4 repositories

Repositories

virgil-at-biocompute/SecureAIGateway

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]

★ 0PythonForks 0