OpenAI
GPT-4o (Aug 2024) benchmark results
6 results on 5 benchmarks from 2 sources.
Closed Released: Aug 6, 2024 Updated Oct 22, 2026
Also listed as: gpt-4o-2024-08-06 · GPT-4o (2024-08-06) · GPT 4o (Aug 2024)
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| GPQA Diamond | 49.2% | 205 | Epoch AI run, accuracy; effort: Aug 2024 | Independent run | Jan 27, 2025 |
| MMLU | 84.3% | 7 | Exact match; 5-shot; effort: Aug 2024 | Official leaderboard via Epoch AI | Aug 6, 2024 |
| HumanEval / HumanEval+ | 92.7% | 3 | HumanEval (base tests), pass@1 greedy“GPT 4o (Aug 2024)” | Official leaderboard | Dec 26, 2024 |
| HumanEval / HumanEval+ | 87.2% | 3 | HumanEval+ (extended tests), pass@1 greedy“GPT 4o (Aug 2024)” | Official leaderboard | Dec 26, 2024 |
| AIME (OTIS Mock AIME 2024–2025) | 6.4% | 229 | Epoch AI run, OTIS Mock AIME 2024–2025; effort: Aug 2024 | Independent run | Feb 25, 2025 |
| MATH Level 5 | 53.3% | 56 | Epoch AI run, accuracy; effort: Aug 2024 | Independent run | Jan 27, 2025 |
FAQ
Where do these GPT-4o (Aug 2024) scores come from?
From Epoch AI Benchmarking Hub and EvalPlus leaderboard. Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.