Gemini 1.5 Flash (May 2024) benchmark results
7 results on 6 benchmarks from 2 sources.
Also listed as: gemini-1.5-flash-001 · Gemini 1.5 Flash (001) · gemini-1.5-flash-0514 · Gemini 1.5 Flash (0514 preview)
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| LMArena Text | 1287 | 298 | Overall, style control on; 62833 votes; 95% CI 1282–1291“gemini-1.5-flash-001” | Official leaderboard | Oct 8, 2026 |
| LMArena Vision | 1060 | 137 | Overall, style control on; 13260 votes; 95% CI 1048–1071“gemini-1.5-flash-001” | Official leaderboard | Oct 2, 2026 |
| GPQA Diamond | 40.4% | 239 | Epoch AI run, accuracy; effort: May 2024 | Independent run | Jan 27, 2025 |
| MMLU | 77.9% | 27 | Exact match; 5-shot; effort: May 2024 | Official leaderboard via Epoch AI | May 23, 2024 |
| MMLU | 77.8% | 28 | Exact match; 5-shot | Official leaderboard via Epoch AI | May 14, 2024 |
| AIME (OTIS Mock AIME 2024–2025) | 3.9% | 239 | Epoch AI run, OTIS Mock AIME 2024–2025; effort: May 2024 | Independent run | Feb 25, 2025 |
| MATH Level 5 | 25.1% | 80 | Epoch AI run, accuracy; effort: May 2024 | Independent run | Jan 27, 2025 |
FAQ
Where do these Gemini 1.5 Flash (May 2024) scores come from?
From Epoch AI Benchmarking Hub and LMArena leaderboard dataset. Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.