Coding · %
LiveCodeBench
Coding problems collected continuously from LeetCode, AtCoder and Codeforces with their release dates, so models can be scored only on problems published after their training cut-off.
What it measures
pass@1 on code generation. We average the official per-problem results for problems dated 2025-01-01 or later.
Limitations
The public leaderboard file has not been updated since August 2025, so recent models are missing. Our window average can differ slightly from the site's default view.
Contamination risk: Low
Time-windowed problems reduce contamination by design.
Leaderboard
22 models
| # | Model | Provider | Score | Rank | Setting | Source type | Date |
|---|---|---|---|---|---|---|---|
| 1 | o4-mini | OpenAI | 75.8% | 1 | Code generation, 182 problems dated 2025-01-01…2025-04-07“O4-Mini (High)” | Official leaderboard | Apr 7, 2025 |
| 2 | Gemini 2.5 Pro (Jun 2025) | 74.2% | 2 | Code generation, 182 problems dated 2025-01-01…2025-04-07“Gemini-2.5-Pro-06-05” | Official leaderboard | Apr 7, 2025 | |
| 3 | o3 | OpenAI | 72.0% | 3 | Code generation, 182 problems dated 2025-01-01…2025-04-07“O3 (High)” | Official leaderboard | Apr 7, 2025 |
| 4 | DeepSeek-R1 (May 2025)OW | DeepSeek | 70.5% | 4 | Code generation, 182 problems dated 2025-01-01…2025-04-07“DeepSeek-R1-0528” | Official leaderboard | Apr 7, 2025 |
| 5 | Gemini 2.5 Pro (May 2025) | 68.1% | 5 | Code generation, 182 problems dated 2025-01-01…2025-04-07“Gemini-2.5-Pro-05-06” | Official leaderboard | Apr 7, 2025 | |
| 6 | OpenReasoning-Nemotron-32BOW | NVIDIA | 66.6% | 6 | Code generation, 182 problems dated 2025-01-01…2025-04-07 | Official leaderboard | Apr 7, 2025 |
| 7 | EXAONE-4.0-32B | — | 66.6% | 6 | Code generation, 182 problems dated 2025-01-01…2025-04-07 | Official leaderboard | Apr 7, 2025 |
| 8 | Grok-3 mini | xAI | 62.6% | 8 | Code generation, 182 problems dated 2025-01-01…2025-04-07“Grok-3-Mini (High)” | Official leaderboard | Apr 7, 2025 |
| 9 | OpenCodeReasoning-Nemotron-1.1-32BOW | NVIDIA | 62.4% | 9 | Code generation, 182 problems dated 2025-01-01…2025-04-07 | Official leaderboard | Apr 7, 2025 |
| 10 | XBai-o4-medium | — | 60.4% | 10 | Code generation, 182 problems dated 2025-01-01…2025-04-07 | Official leaderboard | Apr 7, 2025 |
| 11 | Gemini 2.5 Flash (May 2025) | 59.3% | 11 | Code generation, 182 problems dated 2025-01-01…2025-04-07“Gemini-2.5-Flash-05-20” | Official leaderboard | Apr 7, 2025 | |
| 12 | Qwen3-235B-A22BOW | Alibaba (Qwen) | 59.3% | 11 | Code generation, 182 problems dated 2025-01-01…2025-04-07 | Official leaderboard | Apr 7, 2025 |
| 13 | Gemini 2.5 Flash (Apr 2025) | 56.6% | 13 | Code generation, 182 problems dated 2025-01-01…2025-04-07“Gemini-2.5-Flash-04-17” | Official leaderboard | Apr 7, 2025 | |
| 14 | o3-mini | OpenAI | 51.1% | 14 | Code generation, 182 problems dated 2025-01-01…2025-04-07“O3-Mini-2025-01-31 (Low)” | Official leaderboard | Apr 7, 2025 |
| 15 | Claude Opus 4 | Anthropic | 51.1% | 14 | Code generation, 182 problems dated 2025-01-01…2025-04-07“Claude-Opus-4 (Thinking)” | Official leaderboard | Apr 7, 2025 |
| 16 | Claude Sonnet 4 | Anthropic | 48.9% | 16 | Code generation, 182 problems dated 2025-01-01…2025-04-07“Claude-Sonnet-4 (Thinking)” | Official leaderboard | Apr 7, 2025 |
| 17 | Claude 3.5 Sonnet | Anthropic | 34.8% | 17 | Code generation, 182 problems dated 2025-01-01…2025-04-07“Claude-3.5-Sonnet-20241022” | Official leaderboard | Apr 7, 2025 |
| 18 | GPT-4o (May 2024) | OpenAI | 28.4% | 18 | Code generation, 182 problems dated 2025-01-01…2025-04-07“GPT-4O-2024-08-06” | Official leaderboard | Apr 7, 2025 |
| 19 | GPT-4 Turbo (Nov 2023) | OpenAI | 27.9% | 19 | Code generation, 182 problems dated 2025-01-01…2025-04-07“GPT-4-Turbo-2024-04-09” | Official leaderboard | Apr 7, 2025 |
| 20 | GPT-4o mini | OpenAI | 26.7% | 20 | Code generation, 182 problems dated 2025-01-01…2025-04-07“GPT-4O-mini-2024-07-18” | Official leaderboard | Apr 7, 2025 |
| 21 | Claude 3 Haiku | Anthropic | 23.9% | 21 | Code generation, 182 problems dated 2025-01-01…2025-04-07“Claude-3-Haiku” | Official leaderboard | Apr 7, 2025 |
| 22 | DeepSeek-V3OW | DeepSeek | 14.9% | 22 | Code generation, 182 problems dated 2025-01-01…2025-04-07 | Official leaderboard | Apr 7, 2025 |
Data sources & licences
| Source | Licence / terms | How we reuse it | Last fetched |
|---|---|---|---|
| LiveCodeBench leaderboard LiveCodeBench (Jain et al.), livecodebench.github.io | No explicit licence on the site repo (benchmark code MIT) – factual scores only, with citation | No explicit licence – factual scores only, with citation | Oct 22, 2026 |
FAQ
What does LiveCodeBench measure?
Coding problems collected continuously from LeetCode, AtCoder and Codeforces with their release dates, so models can be scored only on problems published after their training cut-off. pass@1 on code generation. We average the official per-problem results for problems dated 2025-01-01 or later.
How reliable is LiveCodeBench?
The public leaderboard file has not been updated since August 2025, so recent models are missing. Our window average can differ slightly from the site's default view. Contamination risk: Low – Time-windowed problems reduce contamination by design.