Side-by-side comparison · models
Grok 3 vs Grok 4
What we have checked about each, line by line. Every value shows where it came from and when we last confirmed it.
Models
Grok 3
Grok model for agentic tool use, reasoning, coding, and live assistance.
Models
Grok 4
Grok model for agentic tool use, reasoning, coding, and live assistance.
Checked facts
Line by line
| Measure | Grok 3 | Grok 4 |
|---|---|---|
| Time to first token (ms) | 1,430 | 11,220 |
| Output speed (tokens a second) | 75.4 | 73.7 |
| Gpqa diamond | 75.8% (for 9 Apr 2025) | 87% (for 9 July 2025) |
| Arc agi 2 | 0% (for 9 Apr 2025) | 16% (for 9 July 2025) |
| Aider polyglot | 53.3% (for 9 Apr 2025) | 79.6% (for 9 July 2025) |
| Arc agi | 5.5% (for 9 Apr 2025) | 66.7% (for 9 July 2025) |
| Balrog | 29.5% (for 9 Apr 2025) | 43.6% (for 9 July 2025) |
| Fiction livebench | 58.3% (for 9 Apr 2025) | 94.4% (for 9 July 2025) |
| Frontiermath 2025 02 28 private | 3.8% (for 9 Apr 2025) | 19.7% (for 9 July 2025) |
| Frontiermath tier 4 2025 07 01 private | 0% (for 9 Apr 2025) | 2.1% (for 9 July 2025) |
| Lech mazur writing | 76.4% (for 9 Apr 2025) | 76.9% (for 9 July 2025) |
| Math level 5 | 88.7% (for 9 Apr 2025) | Not checked yet |
| Simplebench | 36.1% (for 9 Apr 2025) | 60.5% (for 9 July 2025) |
| Weirdml | 37.2% (for 9 Apr 2025) | 45.7% (for 9 July 2025) |
| Otis mock aime 2024 2025 | 55.6% (saturated benchmark: the top models all score near the ceiling) (for 9 Apr 2025) | 84% (saturated benchmark: the top models all score near the ceiling) (for 9 July 2025) |
| Terminal bench | Not checked yet | 27.2% (for 9 July 2025) |
| Cybench | Not checked yet | 43% (for 9 July 2025) |
| Deepresearch bench | Not checked yet | 47.3% (for 9 July 2025) |
| Gdpval | Not checked yet | 21.1% (for 9 July 2025) |
| Geobench | Not checked yet | 45% (for 9 July 2025) |
| Metr time horizons | Not checked yet | 66.6% (for 9 July 2025) |
A line appears only when at least one record has a value we confirmed from a source. Values we have not confirmed are left out, never guessed. Records of different types share fewer lines.
Add a third
Compare with one more record
How this works
Share it, or build your own
This page works for any two or three records in the directory, of any type. The link stays the same whichever order you name them in, so you can share it as it is. Change the records in the address, for example /directories/vs/claude-code-vs-cursor, or start from our editorial comparisons.