Open Source Alternatives
Open source alternatives to LiteLLM
Open source alternatives to LiteLLM, ranked by GitHub stars and freshness.
12 open-source alternatives in the index, ranked by GitHub stars and freshness.
AI Gateway
Community
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Best for: Developers building multi-model applications who need integrated safety controls
Mirascope
Community
The LLM Anti-Framework
Best for: Python developers who want observability without heavy abstractions for LLM apps
Modelz-LLM
Community
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
Best for: Developers who want to experiment with open-source LLMs using familiar OpenAI API patterns
AI studio
Community
[deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications
Best for: Developers exploring open-source AI gateway patterns for observability
Glide
Community
🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps
Best for: Developers building production GenAI apps who need a lightweight, fast model gateway with built-in observability
amidabuddha/unichat-mcp-server
Various
🐍/📇 ☁️ - Send requests to OpenAI, MistralAI, Anthropic, xAI, Google AI or DeepSeek using MCP protocol via tool or predefined prompts. Vendor API key required
Best for: Developers building MCP-based applications that need to access multiple AI models
JamesANZ/cross-llm-mcp
Various
A Model Context Protocol (MCP) server that provides access to multiple Large Language Model (LLM) APIs including ChatGPT, Claude, Gemini, Mistral, Kimi K2, and DeepSeek.
Best for: Developers who need a unified MCP-based gateway to multiple LLM APIs
TeamoRouter
Community
Use one API key for Claude Code, Codex, and AI coding agents. TeamoRouter helps developers reduce token costs, simplify provider setup, and pay only for usage.
Best for: Developers using multiple AI coding agents who want simplified key management and cost control
TensorZero
Community
TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.
Best for: Teams needing an open-source, end-to-end LLM toolchain for production.
TrueFoundry
Community
TrueFoundry offers an enterprise-grade AI Gateway combining LLM, MCP, and Agent Gateways—empowering businesses to connect, monitor, and govern agentic AI applications across prov
Best for: Teams building and managing multi-provider agentic AI applications in enterprise environments
Vercel AI Gateway
Vercel
One API key, hundreds of LLM models. Unified endpoint with zero token markup, fallbacks, and spend monitoring.
Best for: Teams who use multiple LLM providers and want unified access, observability, and failover
Vercel AI SDK
Vercel
The de facto TypeScript SDK for AI apps. Streaming, tools, multi-model, and now an agent loop.
Best for: TypeScript teams shipping AI features in production