Side-by-side comparison · models
GPT-4o (2024-08-06) vs GPT-4o (2024-11-20)
What we have checked about each, line by line. Every value shows where it came from and when we last confirmed it.
Models
GPT-4o (2024-08-06)
The 2024-08-06 version of GPT-4o offers improved performance in structured outputs, with the ability to supply a JSON schema in the respone_format. Read more [here](https://openai.
Models
GPT-4o (2024-11-20)
The 2024-11-20 version of GPT-4o offers a leveled-up creative writing ability with more natural, engaging, and tailored writing to improve relevance & readability.
Checked facts
Line by line
| Measure | GPT-4o (2024-08-06) | GPT-4o (2024-11-20) |
|---|---|---|
| Input price | $2.50 per million tokens | $2.50 per million tokens |
| Output price | $10.00 per million tokens | $10.00 per million tokens |
| Price on azure | $1.25 per million cached input tokens | Not checked yet |
| Price on azure | $2.50 per million input tokens | Not checked yet |
| Price on azure | $10.00 per million output tokens | Not checked yet |
| Price on openai | $1.25 per million cached input tokens | Not checked yet |
| Price on openai | $2.50 per million input tokens | Not checked yet |
| Price on openai | $10.00 per million output tokens | Not checked yet |
| Latest version | openai/gpt-4o-2024-08-06 | openai/gpt-4o-2024-11-20 |
| Time to first token (ms) | 1,990 | 1,990 |
| Time to first token (ms) on azure | 726 | Not checked yet |
| Time to first token (ms) on openai | 565 | Not checked yet |
| Output speed (tokens a second) | 119.6 | 119.6 |
| Output speed (tokens a second) on azure | 61 | Not checked yet |
| Output speed (tokens a second) on openai | 39 | Not checked yet |
| Tokens served on OpenRouter in a day | 376.5M (for 10 Nov 2026) | 161.8M (for 10 Nov 2026) |
| Tool calls on OpenRouter in a day | 702 (for 10 Nov 2026) | 8.1K (for 10 Nov 2026) |
| Artificial Analysis Intelligence Index | 7.7 | 8.4 |
| LMArena text rating (Elo) | 1,300 | 1,300 |
| LMArena vision rating (Elo) | 1,137 | 1,137 |
| Gpqa diamond | 49.2% (for 6 Aug 2024) | 47.9% (for 20 Nov 2024) |
| Frontiermath tiers 1 3 v2 private | 0.4% (for 6 Aug 2024) | Not checked yet |
| Simpleqa verified | 26% (for 6 Aug 2024) | Not checked yet |
| Aider polyglot | 23.1% (for 6 Aug 2024) | 18.2% (for 20 Nov 2024) |
| Cadeval | 26% (for 6 Aug 2024) | Not checked yet |
| Chess puzzles | 6% (for 6 Aug 2024) | Not checked yet |
| Frontiermath 2025 02 28 private | 0.3% (for 6 Aug 2024) | 0.3% (for 20 Nov 2024) |
| Math level 5 | 53.3% (for 6 Aug 2024) | 49.8% (for 20 Nov 2024) |
| Mmlu | 84.3% (for 6 Aug 2024) | 88.1% (for 20 Nov 2024) |
| Simplebench | 17.8% (for 6 Aug 2024) | Not checked yet |
| Otis mock aime 2024 2025 | 6.4% (saturated benchmark: the top models all score near the ceiling) (for 6 Aug 2024) | 6.3% (saturated benchmark: the top models all score near the ceiling) (for 20 Nov 2024) |
| Swe bench verified | Not checked yet | 31% (for 20 Nov 2024) |
| Arc agi 2 | Not checked yet | 0% (for 20 Nov 2024) |
| Arc agi | Not checked yet | 4.5% (for 20 Nov 2024) |
| Cybench | Not checked yet | 12.5% (for 20 Nov 2024) |
| Gdpval | Not checked yet | 9.9% (for 20 Nov 2024) |
| Geobench | Not checked yet | 71% (for 20 Nov 2024) |
| Gso bench | Not checked yet | 0% (for 20 Nov 2024) |
| Lech mazur writing | Not checked yet | 81.8% (for 20 Nov 2024) |
| The agent company | Not checked yet | 8.6% (for 20 Nov 2024) |
| Vpct | Not checked yet | 40% (for 20 Nov 2024) |
| Weirdml | Not checked yet | 25.1% (for 20 Nov 2024) |
A line appears only when at least one record has a value we confirmed from a source. Values we have not confirmed are left out, never guessed. Records of different types share fewer lines.
Add a third
Compare with one more record
How this works
Share it, or build your own
This page works for any two or three records in the directory, of any type. The link stays the same whichever order you name them in, so you can share it as it is. Change the records in the address, for example /directories/vs/claude-code-vs-cursor, or start from our editorial comparisons.