AI Pulse · Frontier Labs Watch
The play
Benchmark multiple foundation models through a common evaluation suite, since even major AI companies quietly buy competitors' capacity.
Meta reportedly spends hundreds of millions of dollars each year renting AI models from rival labs, including OpenAI, through Microsoft Azure and Foundry. The reported use is substantial, with Meta consuming trillions of tokens a week to benchmark those models against its own.
That matters because Meta is widely seen as one of the strongest advocates for open models. Yet this report suggests it is also willing to pay heavily for access to closed, competing models when it needs an external benchmark. That is a practical reminder for any business owner weighing an open versus closed AI strategy. The question isn’t which camp you belong to. It’s whether the model you’re using performs best for the job, at a cost and level of control you can live with.
For operators, benchmarking should become a normal discipline, not a one-off project. Test the same customer support query, sales research task, document workflow, or reporting prompt across the models you’re considering. Track quality, speed, cost, error rates, and how much human checking remains. The cheapest model can become expensive if staff spend hours correcting its work.
This is also a sign that even the biggest AI builders don’t rely on one model or one provider. They compare, switch, and keep options open. This is the kind of thing we build into an AI command centre, giving teams a practical way to monitor model performance and decide where each tool fits.
Your guide is ready
Check your downloads folder. If it did not open automatically, use the button below.
Download the GuideEDNA Learn
Start free on EDNA Learn
Free account, no card. Run the Claude Code and agent-building course and start earning MENTOR credits.
Start freeFree daily email
Get this every morning.
This brief is one item from today's AI Pulse, the short daily read we run for ourselves on what is actually happening in AI. Subscribe free and it lands in your inbox each morning.
Free daily email
Subscribe to the daily AI Pulse
One short read every morning on what is actually happening in AI. Free.
You are in
Your first AI Pulse lands tomorrow morning. Keep an eye on your inbox.
Free Resource
Put what you just read to work
The free 32-page Working With Claude guide: the full ecosystem, Claude Code, and how to roll it out across a business.
Your guide is ready
Check your downloads folder. If it did not open automatically, use the button below.
Download the Guide