Open Source AI Gateway

Talk to multiple LLMs thru a unified API

Open Source AI Gateway media 1
Open Source AI Gateway media 2
Open Source AI Gateway media 3
Open Source AI Gateway media 4

विवरण

A configurable API gateway for multiple LLM providers (OpenAI, Anthropic, Gemini, Ollama, Mistral and Cohere) with built-in analytics, guardrails, rate limiting, caching and administrative controls. HTTP and gRPC interfaces

अनुशंसित उत्पाद