Mistral AI
Mistral Large 2 (Jul 2024) benchmark results
6 results on 6 benchmarks from 3 sources.
Open weights Released: Jul 24, 2024 Updated Oct 22, 2026
Also listed as: mistral-large-2407 · Mistral Large 2 (2407) · Mistral-Large-Instruct-2407
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| LMArena Text | 1314 | 267 | Overall, style control on; 45459 votes; 95% CI 1310–1318“mistral-large-2407” | Official leaderboard | Oct 8, 2026 |
| GPQA Diamond | 49.0% | 208 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
| MMLU | 80.0% | 18 | Exact match; 5-shot | Official leaderboard via Epoch AI | Jul 24, 2024 |
| MMLU-Pro | 65.9% | 116 | Overall accuracy; data source: TIGER-Lab; 123B“Mistral-Large-Instruct-2407” | Official leaderboard | Mar 11, 2026 |
| AIME (OTIS Mock AIME 2024–2025) | 8.5% | 216 | Epoch AI run, OTIS Mock AIME 2024–2025 | Independent run | Feb 25, 2025 |
| MATH Level 5 | 44.8% | 66 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
FAQ
Where do these Mistral Large 2 (Jul 2024) scores come from?
From Epoch AI Benchmarking Hub, LMArena leaderboard dataset, and MMLU-Pro leaderboard (TIGER-Lab). Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.