GoModel

Overview

GoModel is an AI gateway and control plane written in Go. It provides a unified OpenAI-compatible and Anthropic-compatible API for multiple providers including OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, and vLLM. It includes observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs, and usage tracking.

Best for

Best for
Teams needing a self-hosted, Go-based LLM gateway with routing and observability

Use cases

• Route requests across multiple LLM providers with failover and sticky sessions
• Track token usage and costs in real time across all API calls
• Apply guardrails and observe traffic through a single proxy endpoint

Notes

GoModel is an AI gateway and control plane written in Go. It provides a unified OpenAI-compatible and Anthropic-compatible API for multiple providers including OpenAI, Anthropic, Gemini, Groq, xAI, Ollama, and vLLM. It includes observability, guardrails, streaming, cost tracking, intelligent routing, sticky sessions, failover, real-time logs, and usage tracking.

1,201 stars on GitHub. Last updated 2026-09-30. Licensed MIT.

Use cases

• Route requests across multiple LLM providers with failover and sticky sessions
• Track token usage and costs in real time across all API calls
• Apply guardrails and observe traffic through a single proxy endpoint

Pros

• Unified API for many providers reduces integration overhead
• Built-in observability and cost tracking without extra services
• Written in Go, offering low-latency performance and easy deployment

Cons

• Community-maintained, so support and updates depend on contributors
• Smaller ecosystem and fewer integrations than more established gateways
• Requires self-hosting and operational responsibility for production use

Indexed from awesome-llmops and enriched against its public facts.