Enterprise DNA

Omni by Enterprise DNA

Enterprise DNA Resources

Latest AI and industry news. Practical AI operating-system thinking for owners, operators, and teams doing real work.

220k+

Data professionals

Omni

AI agents and apps

Audit

Map the manual work

News AI News

Open-weight models start competing on cost-per-task, not just benchmark score

Zhipu's GLM-5.3-Flash and Alibaba's Qwen3.8-Flash-Next both landed on Agent Arena's live leaderboard this week (GLM-5.3-Flash at a stated $0.12 median.

Enterprise DNA |
Open-weight models start competing on cost-per-task, not just benchmark score

AI Pulse · AI Trends Pulse

The play

Benchmark open-weight models on your actual tasks and monthly spend, keeping switching options ready as quality gaps narrow.

The conversation around AI models has spent too long focused on benchmark scores. For most businesses, the more useful question is simpler: what does it cost to get a real piece of work done?

This week, Zhipu’s GLM-5.3-Flash and Alibaba’s Qwen3.8-Flash-Next appeared on Agent Arena’s live leaderboard, which tracks performance in real agentic sessions. GLM-5.3-Flash reported a median cost of $0.12 per task across more than 9,000 sessions. At the same time, Tencent open-sourced Hy4 Preview, a 770B-parameter mixture-of-experts model with a context window of more than one million tokens, aimed at coding and agent work.

The detail to watch is not which model wins a single test. It’s whether lower-cost models can complete the repeatable tasks your team actually has, such as preparing research, checking documents, writing code, or moving information between systems. A model that is slightly less capable but reliably completes a task at a fraction of the cost may be the better operational choice.

This is the kind of thing we build into an AI command centre, tracking which models work for which jobs, what they cost, and when a change is worth making.

Working With Claude field guide cover

Free Resource

Put what you just read to work

The free 32-page Working With Claude guide: the full ecosystem, Claude Code, and how to roll it out across a business.

No spam. Unsubscribe any time.

Free daily email

Get this every morning.

This brief is one item from today's AI Pulse, the short daily read we run for ourselves on what is actually happening in AI. Subscribe free and it lands in your inbox each morning.

Free daily email

Subscribe to the daily AI Pulse

One short read every morning on what is actually happening in AI. Free.

One email a day. Unsubscribe any time.