AI Gateway

Overview

AI Gateway is an open-source framework that provides a unified API to route requests to over 1,600 large language models. It includes 50+ built-in guardrails for safety and compliance. Built with TypeScript, it is designed for high performance.

Best for

Best for
Developers building multi-model applications who need integrated safety controls

Use cases

• Centralizing API access to multiple LLMs
• Adding guardrails to LLM outputs
• Switching between models without code changes

Notes

AI Gateway is an open-source framework that provides a unified API to route requests to over 1,600 large language models. It includes 50+ built-in guardrails for safety and compliance. Built with TypeScript, it is designed for high performance.

11,932 stars on GitHub. Last updated 2026-05-25. Licensed MIT.

Use cases

• Centralizing API access to multiple LLMs
• Adding guardrails to LLM outputs
• Switching between models without code changes

Pros

• Unified API for 1,600+ LLMs
• Built-in guardrails reduce integration effort
• High performance with TypeScript

Cons

• Requires self-hosting and maintenance
• Guardrails may add latency
• Open-source community support may be limited compared to commercial alternatives

Indexed from awesome-llm and enriched against its public facts.