Open Source Alternatives
Open source alternatives to LiteLLM
Open source alternatives to LiteLLM, ranked by GitHub stars and freshness.
18 open-source alternatives in the index, ranked by GitHub stars and freshness.
AI Gateway
Community
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Alternative to Litellm
Best for: Developers building multi-model applications who need integrated safety controls
Mirascope
Community
The LLM Anti-Framework
Alternative to Litellm
Best for: Python developers who want observability without heavy abstractions for LLM apps
Entroly
Community
Local proxy that cuts your Claude / OpenAI / Gemini bill 70%+. Drop-in for Cursor, Claude Code, Codex, Aider — 30 seconds, no code changes.
Alternative to Litellm
Best for: Developers using multiple LLM APIs in coding assistants who want to lower their API bills without changing their workflow.
AI studio
Community
[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications
Alternative to Litellm
Best for: Developers exploring open-source AI gateway patterns for observability
ChatAbstractions
Community
LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
Alternative to Litellm
Best for: LangChain users who need robust failover and load-balancing strategies for production chat applications
amidabuddha/unichat-mcp-server
Various
🐍/📇 ☁️ - Send requests to OpenAI, MistralAI, Anthropic, xAI, Google AI or DeepSeek using MCP protocol via tool or predefined prompts. Vendor API key required
Alternative to Litellm
Best for: Developers building MCP-based applications that need to access multiple AI models
Hypersigil
Community
Prompt management gateway with a UI for AI-powered applications. Enables non-technical users to test, refine, and deploy prompts seamlessly across multiple AI providers.
Alternative to Litellm, Llmapp
Best for: Teams that need a simple, self-hosted prompt management UI for non-technical stakeholders.
JamesANZ/cross-llm-mcp
Various
A Model Context Protocol (MCP) server that provides access to multiple Large Language Model (LLM) APIs including ChatGPT, Claude, Gemini, Mistral, Kimi K2, and DeepSeek.
Alternative to Litellm
Best for: Developers who need a unified MCP-based gateway to multiple LLM APIs
smigolsmigol/llmkit
Various
Know what your AI agents cost. API gateway with budget enforcement, session tracking, and MCP tools.
Alternative to Litellm
Best for: Developers building AI agents that need to monitor and constrain LLM API spending
Continuum-AI-Corp/orcarouter-mcp-server
Various
Official MCP server for OrcaRouter — the LLM gateway with auto-routing and fallback chains. Browse models and chat from Claude Desktop, Cursor, Windsurf, or any MCP client.
Alternative to Litellm
Best for: Developers who want to add model routing and fallback logic to their MCP-based tools
nikhilnt1234/TokenBurnRate
Various
[](https://glama.ai/mcp/servers/nikhilnt1234/TokenBurnRate) 📇 🏠 - Track LLM token costs across Claude, GPT and Gemini. MCP server + CLI with optimization hints and $ savings esti
Alternative to Litellm
Best for: Developers who need to monitor and optimize LLM API costs across multiple providers
ReliableGPT 💪
Community
Handle OpenAI Errors (overloaded OpenAI servers, rotated keys, or context window errors) for your production LLM Applications.
Alternative to Litellm
Best for: Developers running OpenAI-based LLM applications in production
systemprompt.io
Community
The governance layer for AI agents. A single compiled Rust binary that authenticates, authorises, rate-limits, logs, and costs every AI interaction. Self-hosted, air-gap capable,
Alternative to Litellm
Best for: Teams that need a lightweight, self-hosted observability and access control layer for AI agents in secure or air-gapped environments.
TeamoRouter
Community
Use one API key for Claude Code, Codex, and AI coding agents. TeamoRouter helps developers reduce token costs, simplify provider setup, and pay only for usage.
Alternative to Litellm
Best for: Developers using multiple AI coding agents who want simplified key management and cost control
TrueFoundry
Community
TrueFoundry offers an enterprise-grade AI Gateway combining LLM, MCP, and Agent Gateways—empowering businesses to connect, monitor, and govern agentic AI applications across prov
Alternative to Litellm
Best for: Teams building and managing multi-provider agentic AI applications in enterprise environments
Vercel AI Gateway
Vercel
One API key, hundreds of LLM models. Unified endpoint with zero token markup, fallbacks, and spend monitoring.
Alternative to Litellm
Best for: Teams who use multiple LLM providers and want unified access, observability, and failover
Helicone AI
Various
AI Gateway & LLM Observability
Alternative to Litellm
Best for: Teams building LLM-powered applications that need transparent observability and cost management.
Manifest
Various
Route every request to the most cost effective model and save up to 70% on AI tokens. Track cost and set usage limits.
Alternative to Litellm
Best for: Teams and developers who want to optimize AI spending across multiple model providers