Stars
40.6k
GitHub star count
Last Release
N/A
N/A
Contributors
0
N/A
Health Score
N/A
N/A
Key Features
ai gateway
anthropic
azure openai
bedrock
gateway
Tech Stack
About
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock,...
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Analyst Note
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Best For
- Technical stack evaluation for engineering teams
- Dependency governance and upgrade planning in production systems
- Track delivery cadence and release quality from BerriAI
- ai gateway
Not Ideal For
- Large open issue backlog.
Typical Use Cases
Decision Snapshot
- Product type: Open Source
- Primary language: Python
- Pricing model: Free
- License: NOASSERTION
Data Basis
- Last Sync: Mar 26, 2026, 12:05 AM
- Metrics Updated: Mar 26, 2026, 12:05 AM
- Completeness: 82%
- Last Verified: Mar 26, 2026, 12:05 AM
Data Status
Pros & Cons
Pros
- Strong community adoption.
- Active maintenance cadence.
Cons
- -Large open issue backlog.