Inferrail

Overview

Inferrail is a self-hosted gateway that is compatible with OpenAI and Anthropic APIs. It assigns a dollar budget to each AI agent run and enforces that budget before the request reaches the provider. It records a payload-free cost record for each run, allowing cost tracking without storing request data.

Best for

Best for
Developers who need simple, self-hosted cost controls for AI agent runs.

Use cases

• Set per-run dollar budgets for AI agents
• Enforce spending limits before provider calls
• Track AI agent costs with lightweight per-run records

Notes

Inferrail is a self-hosted gateway that is compatible with OpenAI and Anthropic APIs. It assigns a dollar budget to each AI agent run and enforces that budget before the request reaches the provider. It records a payload-free cost record for each run, allowing cost tracking without storing request data.

0 stars on GitHub. Last updated 2026-10-04. Licensed Apache-2.0.

Use cases

• Set per-run dollar budgets for AI agents
• Enforce spending limits before provider calls
• Track AI agent costs with lightweight per-run records

Pros

• Self-hosted for full control
• OpenAI and Anthropic compatible
• Enforces budgets before hitting the provider

Cons

• Community project with no stars or track record
• Python only
• No built-in UI or advanced analytics mentioned

Indexed from awesome-llmops and enriched against its public facts.