Open Source Alternatives
Open source alternatives to LiteLLM
Open source alternatives to LiteLLM, ranked by GitHub stars and freshness.
20 open-source alternatives in the index, ranked by GitHub stars and freshness.
AI Gateway
Community
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Alternative to Litellm
Best for: Developers building multi-model applications who need integrated safety controls
Bifrost
Community
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
Alternative to Litellm
Best for: Engineering teams needing ultra-fast, scalable model routing with built-in safety controls
Mirascope
Community
The LLM Anti-Framework
Alternative to Litellm
Best for: Python developers who want observability without heavy abstractions for LLM apps
Entroly
Community
Local proxy that cuts your Claude / OpenAI / Gemini bill 70%+. Drop-in for Cursor, Claude Code, Codex, Aider — 30 seconds, no code changes.
Alternative to Litellm
Best for: Developers using multiple LLM APIs in coding assistants who want to lower their API bills without changing their workflow.
Modelz-LLM
Community
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
Alternative to Litellm, Fastchat
Best for: Developers who want to experiment with open-source LLMs using familiar OpenAI API patterns
AI studio
Community
[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications
Alternative to Litellm
Best for: Developers exploring open-source AI gateway patterns for observability
Glide
Community
🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps
Alternative to Litellm
Best for: Developers building production GenAI apps who need a lightweight, fast model gateway with built-in observability
ypollak2/llm-router
Various
Universal LLM router for AI coding tools. Works with Claude Code, Cursor, Codex, Gemini CLI, Copilot and more. Free-first fallback chain keeps costs 70–85% lower.
Alternative to Litellm
Best for: Developers using multiple AI coding assistants who want to minimize API costs.
Hypersigil
Community
Prompt management gateway with a UI for AI-powered applications. Enables non-technical users to test, refine, and deploy prompts seamlessly across multiple AI providers.
Alternative to Litellm
Best for: Teams that need a simple, self-hosted prompt management UI for non-technical stakeholders.
JamesANZ/cross-llm-mcp
Various
A Model Context Protocol (MCP) server that provides access to multiple Large Language Model (LLM) APIs including ChatGPT, Claude, Gemini, Mistral, Kimi K2, and DeepSeek.
Alternative to Litellm
Best for: Developers who need a unified MCP-based gateway to multiple LLM APIs
smigolsmigol/llmkit
Various
Know what your AI agents cost. API gateway with budget enforcement, session tracking, and MCP tools.
Alternative to Litellm
Best for: Developers building AI agents that need to monitor and constrain LLM API spending
spanlens/Spanlens
Various
Open source LLM observability and monitoring. Drop-in proxy for OpenAI, Anthropic, and Gemini with request logging, cost tracking, and agent tracing. Self-host with one Docker comm
Alternative to Litellm
Best for: Developers who want lightweight, self-hosted LLM observability without vendor lock-in.
sachinuppal/modelcostsaver
Various
Offline MCP server that predicts LLM call cost and recommends the cheapest capable model before you call it. No API keys, no network. npx @workswarm/modelcostsaver
Alternative to Litellm
Best for: Developers building MCP-based workflows who want to minimize LLM call costs without relying on external services.
Maxim AI
Community
At Maxim AI, we are building the production infrastructure for AI. Maxim’s stack comprising gateway and governance, observability, and evals empowers AI teams to ship agents with
Alternative to Litellm
Best for: Teams shipping AI agents to production who need a unified observability, governance, and evaluation platform.
ReliableGPT 💪
Community
Handle OpenAI Errors (overloaded OpenAI servers, rotated keys, or context window errors) for your production LLM Applications.
Alternative to Litellm
Best for: Developers running OpenAI-based LLM applications in production
TeamoRouter
Community
Use one API key for Claude Code, Codex, and AI coding agents. TeamoRouter helps developers reduce token costs, simplify provider setup, and pay only for usage.
Alternative to Litellm
Best for: Developers using multiple AI coding agents who want simplified key management and cost control
TrueFoundry
Community
TrueFoundry offers an enterprise-grade AI Gateway combining LLM, MCP, and Agent Gateways—empowering businesses to connect, monitor, and govern agentic AI applications across prov
Alternative to Litellm
Best for: Teams building and managing multi-provider agentic AI applications in enterprise environments
Vercel AI Gateway
Vercel
One API key, hundreds of LLM models. Unified endpoint with zero token markup, fallbacks, and spend monitoring.
Alternative to Litellm
Best for: Teams who use multiple LLM providers and want unified access, observability, and failover
Manifest
Various
Route every request to the most cost effective model and save up to 70% on AI tokens. Track cost and set usage limits.
Alternative to Litellm
Best for: Teams and developers who want to optimize AI spending across multiple model providers
OpenRouter
Various
The unified interface for LLMs. Find the best models & prices for your prompts
Alternative to Litellm
Best for: Developers who want one API for many LLMs without managing multiple provider accounts.