01.AI
Yi-1.5-34B benchmark results
5 results on 5 benchmarks from 4 sources.
Open weights Released: May 13, 2024 Updated Oct 22, 2026
Also listed as: yi-1.5-34b-chat · Yi-1.5-34B-Chat · 01-ai/Yi-1.5-34B-Chat · 01-ai/Yi-1.5-34B-Chat-16K · 01-ai/Yi-1.5-34B-32K · 01-ai/Yi-1.5-34B
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| LMArena Text | 1213 | 340 | Overall, style control on; 24146 votes; 95% CI 1208–1218“yi-1.5-34b-chat” | Official leaderboard | Oct 8, 2026 |
| Open LLM Leaderboard v2 | 33.4% | 767 | Average of 6 normalised benchmarks; bfloat16; 34.389B params“01-ai/Yi-1.5-34B-Chat” | Official leaderboard | Mar 13, 2025 |
| GPQA Diamond | 32.0% | 257 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
| MMLU-Pro | 52.3% | 161 | Overall accuracy; data source: TIGER-Lab; 34B“Yi-1.5-34B-Chat” | Official leaderboard | Mar 11, 2026 |
| MATH Level 5 | 25.5% | 79 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
Related on this site
FAQ
Where do these Yi-1.5-34B scores come from?
From Epoch AI Benchmarking Hub, LMArena leaderboard dataset, MMLU-Pro leaderboard (TIGER-Lab), and Hugging Face Open LLM Leaderboard v2 (archived). Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.