Open Source Alternatives
Open source alternatives to LiteLLM
Open source alternatives to LiteLLM, ranked by GitHub stars and freshness.
17 open-source alternatives in the index, ranked by GitHub stars and freshness.
AI Gateway
Community
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Best for: Developers building multi-model applications who need integrated safety controls
Mirascope
Community
The LLM Anti-Framework
Best for: Python developers who want observability without heavy abstractions for LLM apps
Entroly
Community
Local proxy that cuts your Claude / OpenAI / Gemini bill 70%+. Drop-in for Cursor, Claude Code, Codex, Aider — 30 seconds, no code changes.
Best for: Developers using multiple LLM APIs in coding assistants who want to lower their API bills without changing their workflow.
AI studio
Community
[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications
Best for: Developers exploring open-source AI gateway patterns for observability
ChatAbstractions
Community
LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
Best for: LangChain users who need robust failover and load-balancing strategies for production chat applications
amidabuddha/unichat-mcp-server
Various
🐍/📇 ☁️ - Send requests to OpenAI, MistralAI, Anthropic, xAI, Google AI or DeepSeek using MCP protocol via tool or predefined prompts. Vendor API key required
Best for: Developers building MCP-based applications that need to access multiple AI models
Hypersigil
Community
Prompt management gateway with a UI for AI-powered applications. Enables non-technical users to test, refine, and deploy prompts seamlessly across multiple AI providers.
Best for: Teams that need a simple, self-hosted prompt management UI for non-technical stakeholders.
JamesANZ/cross-llm-mcp
Various
A Model Context Protocol (MCP) server that provides access to multiple Large Language Model (LLM) APIs including ChatGPT, Claude, Gemini, Mistral, Kimi K2, and DeepSeek.
Best for: Developers who need a unified MCP-based gateway to multiple LLM APIs
smigolsmigol/llmkit
Various
Know what your AI agents cost. API gateway with budget enforcement, session tracking, and MCP tools.
Best for: Developers building AI agents that need to monitor and constrain LLM API spending
Continuum-AI-Corp/orcarouter-mcp-server
Various
Official MCP server for OrcaRouter — the LLM gateway with auto-routing and fallback chains. Browse models and chat from Claude Desktop, Cursor, Windsurf, or any MCP client.
Best for: Developers who want to add model routing and fallback logic to their MCP-based tools
ReliableGPT 💪
Community
Handle OpenAI Errors (overloaded OpenAI servers, rotated keys, or context window errors) for your production LLM Applications.
Best for: Developers running OpenAI-based LLM applications in production
systemprompt.io
Community
The governance layer for AI agents. A single compiled Rust binary that authenticates, authorises, rate-limits, logs, and costs every AI interaction. Self-hosted, air-gap capable,
Best for: Teams that need a lightweight, self-hosted observability and access control layer for AI agents in secure or air-gapped environments.
TeamoRouter
Community
Use one API key for Claude Code, Codex, and AI coding agents. TeamoRouter helps developers reduce token costs, simplify provider setup, and pay only for usage.
Best for: Developers using multiple AI coding agents who want simplified key management and cost control
TrueFoundry
Community
TrueFoundry offers an enterprise-grade AI Gateway combining LLM, MCP, and Agent Gateways—empowering businesses to connect, monitor, and govern agentic AI applications across prov
Best for: Teams building and managing multi-provider agentic AI applications in enterprise environments
Vercel AI Gateway
Vercel
One API key, hundreds of LLM models. Unified endpoint with zero token markup, fallbacks, and spend monitoring.
Best for: Teams who use multiple LLM providers and want unified access, observability, and failover
Helicone AI
Various
AI Gateway & LLM Observability
Best for: Teams building LLM-powered applications that need transparent observability and cost management.
Manifest
Various
Route every request to the most cost effective model and save up to 70% on AI tokens. Track cost and set usage limits.
Best for: Teams and developers who want to optimize AI spending across multiple model providers