OpenAI
o1 benchmark results
11 results on 6 benchmarks from 2 sources.
Also listed as: o1-2024-12-17 · o1-2024-12-17_low · o1 (low) · o1-2024-12-17_high · o1 (high) · o1-2024-12-17_medium · o1 (medium) · o1-2024-12-17_unknown · o1 (unknown thinking) · o1 (December 2024)
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| LMArena Text | 1402 | 156 | Overall, style control on; 27807 votes; 95% CI 1398–1407“o1-2024-12-17” | Official leaderboard | Oct 8, 2026 |
| LMArena Vision | 1193 | 90 | Overall, style control on; 3694 votes; 95% CI 1182–1204“o1-2024-12-17” | Official leaderboard | Oct 2, 2026 |
| GPQA Diamond | 76.8% | 129 | Epoch AI run, accuracy; effort: high | Independent run | Feb 13, 2025 |
| GPQA Diamond | 75.8% | 135 | Epoch AI run, accuracy; effort: medium | Independent run | Jan 27, 2025 |
| GPQA Diamond | 74.2% | 145 | Epoch AI run, accuracy; effort: low | Independent run | Jul 20, 2026 |
| AIME (OTIS Mock AIME 2024–2025) | 73.3% | 120 | Epoch AI run, OTIS Mock AIME 2024–2025; effort: high | Independent run | Jul 15, 2026 |
| AIME (OTIS Mock AIME 2024–2025) | 73.3% | 120 | Epoch AI run, OTIS Mock AIME 2024–2025; effort: medium | Independent run | Feb 27, 2025 |
| AIME (OTIS Mock AIME 2024–2025) | 53.3% | 161 | Epoch AI run, OTIS Mock AIME 2024–2025; effort: low | Independent run | Jul 15, 2026 |
| MATH Level 5 | 94.7% | 17 | Epoch AI run, accuracy; effort: high | Independent run | Feb 13, 2025 |
| MATH Level 5 | 94.4% | 18 | Epoch AI run, accuracy; effort: medium | Independent run | Jan 27, 2025 |
| Humanity's Last Exam | 8.0% | 39 | Compiled by Epoch AI; effort: unknown thinking | Third-party compilation via Epoch AI | Dec 17, 2024 |
FAQ
Where do these o1 scores come from?
From Epoch AI Benchmarking Hub and LMArena leaderboard dataset. Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.