Anthropic
Claude 3.5 Sonnet (October 2024) benchmark results
5 results on 5 benchmarks from 1 sources.
Closed Released: Oct 22, 2024 Updated Oct 22, 2026
Also listed as: claude-3-5-sonnet-20241022 · Claude 3.5 Sonnet (Oct 2024) · Claude 3.5 Sonnet (20241022)
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| GPQA Diamond | 55.3% | 195 | Epoch AI run, accuracy; effort: Oct 2024 | Independent run | Jan 27, 2025 |
| MMLU | 87.3% | 1 | Exact match; 5-shot; effort: Oct 2024 | Official leaderboard via Epoch AI | Oct 22, 2024 |
| AIME (OTIS Mock AIME 2024–2025) | 8.5% | 216 | Epoch AI run, OTIS Mock AIME 2024–2025; effort: Oct 2024 | Independent run | Feb 25, 2025 |
| MATH Level 5 | 57.0% | 53 | Epoch AI run, accuracy; effort: Oct 2024 | Independent run | Jan 27, 2025 |
| Humanity's Last Exam | 4.1% | 49 | Compiled by Epoch AI; effort: Oct 2024 | Third-party compilation via Epoch AI | Oct 22, 2024 |
FAQ
Where do these Claude 3.5 Sonnet (October 2024) scores come from?
From Epoch AI Benchmarking Hub. Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.