AISIX

Overview

AISIX is an open-source AI gateway written in Rust. It exposes a single OpenAI-compatible API for multiple LLM providers including OpenAI, Anthropic, Gemini, and Bedrock. It handles routing, guardrails, caching, rate limits, and observability.

Best for

Best for
Developers building multi-provider LLM applications who want a lightweight gateway

Use cases

• Route requests across multiple LLM providers
• Enforce rate limits and caching for AI agents
• Monitor LLM usage through a unified API

Notes

AISIX is an open-source AI gateway written in Rust. It exposes a single OpenAI-compatible API for multiple LLM providers including OpenAI, Anthropic, Gemini, and Bedrock. It handles routing, guardrails, caching, rate limits, and observability.

177 stars on GitHub. Last updated 2026-10-01. Licensed Apache-2.0.

Use cases

• Route requests across multiple LLM providers
• Enforce rate limits and caching for AI agents
• Monitor LLM usage through a unified API

Pros

• Single OpenAI-compatible interface simplifies integration
• Rust gives low latency and memory safety
• Includes guardrails and observability out of the box

Cons

• Young project with only 177 GitHub stars
• Community support may be limited
• Rust codebase may be a barrier for some contributors

Indexed from awesome-llmops and enriched against its public facts.