Anthropic
Claude 2 benchmark results
5 results on 5 benchmarks from 2 sources.
Also listed as: claude-2.0 · claude-2 · RAG + Claude 2
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| GPQA Diamond | 34.7% | 249 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
| MMLU | 78.5% | 13 | Exact match; 5-shot | Vendor-reported via Epoch AI | Jul 11, 2023 |
| SWE-bench Verified | 4.4% | 107 | agent: RAG baseline“claude-2” | Official leaderboard | Oct 10, 2023 |
| AIME (OTIS Mock AIME 2024–2025) | 2.5% | 244 | Epoch AI run, OTIS Mock AIME 2024–2025 | Independent run | Mar 7, 2025 |
| MATH Level 5 | 11.7% | 94 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
FAQ
Where do these Claude 2 scores come from?
From Epoch AI Benchmarking Hub and SWE-bench leaderboards (swebench.com). Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.