Open Source
TensorZero
by TensorZero
A self-hosted LLM gateway written in Rust, with evaluation, optimisation and A/B testing tools. Its company wound it down in June 2026 and archived the repository, so it is no longer maintained.
This project appears archived and may no longer be maintained.
Our verdict
A self-hosted LLM gateway written in Rust, with evaluation, optimisation and A/B testing tools. Its company wound it down in June 2026 and archived the repository, so it is no longer maintained.
Best for: Teams already running it who need to plan a move, or developers studying its gateway and feedback design.
Choose something else if: you are choosing a gateway for new work. It will get no further fixes, providers or models, so pick a maintained gateway instead.
Source review
Using TensorZero in practice
Where it runs
Self-hosted only, with your own provider keys and your own Postgres or ClickHouse database.
How to install
Needs Docker Compose and a provider key. Set OPENAI_API_KEY, add a tensorzero.toml config, download the quickstart compose file and start it. Clients call http://localhost:3000/openai/v1.
Install commands
curl -LO "https://raw.githubusercontent.com/tensorzero/tensorzero/refs/heads/main/examples/docs/guides/quickstart/docker-compose.yml"
docker compose upAs published in the linked sources. Not run by us.
What it costs
Free under the Apache 2.0 licence. You pay your model providers and your own infrastructure. Its paid add-on, Autopilot, was in private beta and never published a price.
Prices and plans change. Check the linked sources before committing.
Why consider it
- Apache 2.0 licence, with an OpenAI-compatible endpoint and inferences and feedback stored in your own database.
- The code, documentation and quickstart files remain readable on GitHub.
What to watch for
- The repository was archived on 12 June 2026, so no security fixes will follow.
- Versions before 2026.6.0 have a high-severity file read and server-side request forgery flaw. Anyone still running it needs 2026.6.0.
- The website's documentation pages now redirect to the docs folder in the repository.
A first task to try
If you run it today, check your version against 2026.6.0, then list the gateway features you rely on so you can plan a move.
Suggested exercise, not an installation test. We reviewed the linked documentation; no host compatibility is implied.
Other options to understand
Related tools can solve different parts of the same job. Compare fit before treating them as replacements.
Key facts
What we have checked
Not checked yet. Dated facts such as prices, releases and repository activity appear here once we have confirmed them from a source.
Alternatives
Alternatives to TensorZero
| Record | Type | How we know | Checked |
|---|---|---|---|
| DifyThis is an alternative to it | Open source | Named in the listing | Not dated |
| LangChainThis is an alternative to it | App | Named in the listing | Not dated |
Compare
Compare TensorZero side by side
Sources
Where this comes from
- Website notice: no longer maintainedOur review
- Archived repositoryOur review
- QuickstartOur review
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
Shut down
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.