Open Source
TensorZero
by TensorZero
A self-hosted LLM gateway written in Rust, with evaluation, optimisation and A/B testing tools. Its company wound it down in June 2026 and archived the repository, so it is no longer maintained.
This project appears archived and may no longer be maintained.
Our verdict
A self-hosted LLM gateway written in Rust, with evaluation, optimisation and A/B testing tools. Its company wound it down in June 2026 and archived the repository, so it is no longer maintained.
Best for: Teams already running it who need to plan a move, or developers studying its gateway and feedback design.
Choose something else if: you are choosing a gateway for new work. It will get no further fixes, providers or models, so pick a maintained gateway instead.
Source review
Using TensorZero in practice
Where it runs
Self-hosted only, with your own provider keys and your own Postgres or ClickHouse database.
How to install
Needs Docker Compose and a provider key. Set OPENAI_API_KEY, add a tensorzero.toml config, download the quickstart compose file and start it. Clients call http://localhost:3000/openai/v1.
Install commands
curl -LO "https://raw.githubusercontent.com/tensorzero/tensorzero/refs/heads/main/examples/docs/guides/quickstart/docker-compose.yml"
docker compose upAs published in the linked sources. Not run by us.
What it costs
Free under the Apache 2.0 licence. You pay your model providers and your own infrastructure. Its paid add-on, Autopilot, was in private beta and never published a price.
Prices and plans change. Check the linked sources before committing.
Why consider it
- Apache 2.0 licence, with an OpenAI-compatible endpoint and inferences and feedback stored in your own database.
- The code, documentation and quickstart files remain readable on GitHub.
What to watch for
- The repository was archived on 12 June 2026, so no security fixes will follow.
- Versions before 2026.6.0 have a high-severity file read and server-side request forgery flaw. Anyone still running it needs 2026.6.0.
- The website's documentation pages now redirect to the docs folder in the repository.
A first task to try
If you run it today, check your version against 2026.6.0, then list the gateway features you rely on so you can plan a move.
Suggested exercise, not an installation test. We reviewed the linked documentation; no host compatibility is implied.
Other options to understand
Related tools can solve different parts of the same job. Compare fit before treating them as replacements.
Key facts
What we have checked
- Latest version
- 2026.6.0 (released 4 June 2026)
- Days since the last commit
- 156
- GitHub forks
- 966
- GitHub stars
- 11,701
- Releases in the last 90 days
- 0
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How TensorZero is growing
11,710 to 11,701
Health and security
Is TensorZero looked after, and what do its setup files show
Health score
0 out of 100
| Part | Points | What we saw |
|---|---|---|
| Archived | 0 | Repository is archived |
Alternatives
Alternatives to TensorZero
| Record | Type | How we know | Checked |
|---|---|---|---|
| DifyThis is an alternative to it | Open source | Named in the listing | Not dated |
| LangChainThis is an alternative to it | App | Named in the listing | Not dated |
Compare
Compare TensorZero side by side
Sources
Where this comes from
- GitHubOfficial
- GitHubRegistry
- Website notice: no longer maintainedOur review
- Archived repositoryOur review
- QuickstartOur review
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
Shut down
Released 2026.6.0
Released 2026.5.2
Released 2026.5.1
Released 2026.5.0
Released 2026.4.1
Released 2026.4.0
Released 2026.3.4
Released 2026.3.3
Released 2026.3.2
Released 2026.3.1
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.