OpenAI
GPT-4o (Nov 2024) benchmark results
6 results on 6 benchmarks from 1 sources.
Also listed as: gpt-4o-2024-11-20 · GPT-4o (November 2024) · GPT-4o
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| GPQA Diamond | 47.9% | 213 | Epoch AI run, accuracy; effort: Nov 2024 | Independent run | Feb 5, 2025 |
| MMLU | 88.1% | 1 | Exact match; 5-shot; effort: Nov 2024 | Paper / tech report via Epoch AI | Nov 20, 2024 |
| SWE-bench Verified | 31.0% | 33 | Epoch AI run (Epoch scaffold); effort: Nov 2024 | Independent run | Feb 11, 2026 |
| AIME (OTIS Mock AIME 2024–2025) | 6.3% | 230 | Epoch AI run, OTIS Mock AIME 2024–2025; effort: Nov 2024 | Independent run | Feb 25, 2025 |
| MATH Level 5 | 49.8% | 61 | Epoch AI run, accuracy; effort: Nov 2024 | Independent run | Feb 5, 2025 |
| Humanity's Last Exam | 2.7% | 51 | Compiled by Epoch AI; effort: Nov 2024 | Third-party compilation via Epoch AI | Nov 20, 2024 |
FAQ
Where do these GPT-4o (Nov 2024) scores come from?
From Epoch AI Benchmarking Hub. Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.