01.AI
Yi-34B benchmark results
8 results on 6 benchmarks from 4 sources.
Open weights Released: Nov 2, 2023 Updated Oct 22, 2026
Also listed as: yi-34b-chat · Yi-34B-Chat · Yi (34B) · Yi 34B · Yi-Chat 34B · 01-ai/Yi-34B-Chat · 01-ai/Yi-34B · 01-ai/Yi-34B-200K
All benchmark results
| Benchmarks | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|
| LMArena Text | 1184 | 353 | Overall, style control on; 15483 votes; 95% CI 1177–1191“yi-34b-chat” | Official leaderboard | Oct 8, 2026 |
| Open LLM Leaderboard v2 | 24.2% | 1759 | Average of 6 normalised benchmarks; bfloat16; 34.389B params“01-ai/Yi-34B-Chat” | Official leaderboard | Mar 13, 2025 |
| GPQA Diamond | 14.7% | 280 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
| MMLU | 76.3% | 17 | Exact match; 5-shot | Paper / tech report via Epoch AI | Nov 2, 2023 |
| MMLU | 67.6% | 33 | Exact match; 0-shot | Paper / tech report via Epoch AI | Nov 22, 2023 |
| MMLU | 76.2% | 36 | Exact match; 5-shot | Official leaderboard via Epoch AI | Nov 2, 2023 |
| MMLU-Pro | 43.0% | 184 | Overall accuracy; data source: TIGER-Lab; 34B | Official leaderboard | Mar 11, 2026 |
| MATH Level 5 | 5.2% | 102 | Epoch AI run, accuracy | Independent run | Jan 27, 2025 |
FAQ
Where do these Yi-34B scores come from?
From Epoch AI Benchmarking Hub, LMArena leaderboard dataset, MMLU-Pro leaderboard (TIGER-Lab), and Hugging Face Open LLM Leaderboard v2 (archived). Each row links to the original leaderboard, dataset or report, and vendor-reported numbers are labelled.