Gemini 1.5 Pro (Sept 2024) benchmark results
10 results on 9 benchmarks from 4 sources.
Closed Released: Sep 24, 2024 Updated Oct 22, 2026
Also listed as: gemini-1.5-pro-002 · Gemini-1.5-Pro-002 · Gemini 1.5 Pro (002) · Gemini 1.5 Pro 002
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| LMArena Text | 1351 | 214 | Overall, style control on; 55606 votes; 95% CI 1348–1355“gemini-1.5-pro-002” | Official leaderboard | Oct 8, 2026 |
| LMArena Vision | 1179 | 98 | Overall, style control on; 8902 votes; 95% CI 1170–1188“gemini-1.5-pro-002” | Official leaderboard | Oct 2, 2026 |
| GPQA Diamond | 57.2% | 186 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
| MMLU | 86.9% | 3 | Exact match; 5-shot | Official leaderboard via Epoch AI | Sep 24, 2024 |
| MMLU-Pro | 70.3% | 100 | Overall accuracy; data source: TIGER-Lab“Gemini-1.5-Pro-002” | Official leaderboard | Mar 11, 2026 |
| HumanEval / HumanEval+ | 89.0% | 8 | HumanEval (base tests), pass@1 greedy“Gemini 1.5 Pro 002” | Official leaderboard | Dec 26, 2024 |
| HumanEval / HumanEval+ | 79.3% | 13 | HumanEval+ (extended tests), pass@1 greedy“Gemini 1.5 Pro 002” | Official leaderboard | Dec 26, 2024 |
| AIME (OTIS Mock AIME 2024–2025) | 23.1% | 201 | Epoch AI run, OTIS Mock AIME 2024–2025 | Independent run | Feb 25, 2025 |
| MATH Level 5 | 70.4% | 41 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
| Humanity's Last Exam | 4.6% | 46 | Compiled by Epoch AI | Third-party compilation via Epoch AI | Sep 24, 2024 |
FAQ
Where do these Gemini 1.5 Pro (Sept 2024) scores come from?
From Epoch AI Benchmarking Hub, EvalPlus leaderboard, LMArena leaderboard dataset, and MMLU-Pro leaderboard (TIGER-Lab). Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.