Enterprise DNA Enterprise DNA
Directories / Models / Learn / Model routing

Models · Guide

How to run many models, not one

The best model changes every week. Chasing it by hand is a losing game. The operators who win do not pick one model, they route each step of the work to the right one. Here is how that works, and what it takes to run it in production.

Updated

Why one choice will not hold

3

new models in the last 4 days

16

price moves in the same window

1

context-window expansions

1,341

models tracked in the catalogue

Live from the model pulse. A model you hard-code into a workflow today can be beaten on price or quality within weeks. That is the case for making the choice a setting, not a commitment.

What model routing actually is

Model routing is treating your models like a team, not a single hire. Each step of a workflow goes to the cheapest model that is good enough for that step, rather than pointing everything at one model and hoping.

It buys you three things at once. Better quality, because the high-stakes steps get a strong model instead of a compromise. Lower cost, because the high-volume steps run on a cheap model instead of a frontier one. And resilience, because when a provider has an outage or raises its price, you reroute to a fallback instead of watching the workflow stop.

A worked example

One customer-support workflow, four different models

The same job, broken into steps. Notice that no single model would be the right call for all of them.

1

Classify the incoming message

Runs on every message. A budget model that clears the bar saves the most here.

High volume, low stakes

A cheap, fast model

2

Pull and summarise the relevant records

Needs to fit a lot of context, but does not need frontier reasoning.

Long input, medium stakes

A long-context mid model

3

Decide the action and draft the reply

This is the step a customer sees. Worth a better model.

Higher stakes, customer-facing

A strong general model

4

Check the draft against policy before it sends

The one gate that stops an expensive mistake. Buy the best for it.

High stakes, low volume

A top reasoning model

Four steps, four models, one workflow. The cheap model handles the volume, the strong model handles the moment that matters, and the whole thing costs a fraction of running everything on a frontier model, with better quality where it counts.

The routing is easy. The plumbing is the work.

Deciding which model does what is the simple part. Running it in production is where the effort actually lives, and it is real work that never quite finishes:

  • Keys and access for every provider you route to, kept secure and rotated.
  • Fallbacks so an outage or a rate limit reroutes instead of failing the job.
  • Evals so that swapping a model for a cheaper one does not quietly drop your quality.
  • Spend tracking per model and per workflow, so you can see where the money goes.
  • Keeping current as new models and price cuts land every week, and updating the routing when a better option appears.

None of this is glamorous, and all of it is required. It is the difference between a clever demo and something you can trust with the business. Most teams underestimate it, wire everything to one model to avoid it, and pay for that shortcut in cost and fragility.

The command centre

This is exactly what Omni is for

Omni by Enterprise DNA is the command centre that runs the intelligence supply chain for you. It routes each job to the right model, holds the keys, handles the fallbacks, runs the evals, tracks the spend, and stays current as the frontier moves, so you get the best of every model without managing any of the plumbing.

You keep the leaderboard for what it is good at: seeing what is possible. Omni turns that into a running system. The comparison traffic you came here for becomes a working stack in your business, wired to your data and your tools, shipping real work.

Common questions

What is model routing?

Model routing is matching each step of a workflow to the cheapest model that is good enough for that step, instead of sending everything to one model. High-stakes steps go to a strong model, high-volume steps go to a cheap one, and long-input steps go to a long-context one. It lowers cost and often improves quality at the same time.

Why not just use one good model for everything?

Because most steps in a real workflow do not need a frontier model, and paying frontier rates for them wastes money at scale. A single model also gives you a single point of failure and locks you to one vendor. Routing spreads the work to the right tool and keeps a fallback when a provider has an outage.

Is it hard to run several models in one workflow?

The routing logic is simple. The operational work around it is the hard part: managing keys for each provider, handling fallbacks, running evals so a swap does not quietly break quality, tracking spend per model, and keeping up as new models ship every week. That plumbing is exactly what a command centre like Omni handles for you.

How often do the best models change?

Constantly. In the last 4 days alone the catalogue saw 3 new models and 16 price moves. A model choice you hard-code today is likely to be beaten on price or quality within weeks, which is why routing decisions should be a setting you can change, not something baked into your code.