Skip to content
English

Switch theme

// ∞ Reasoning & Test-Time Compute

DeepSeek-R1 Reasoning RL Recipe

Large-scale outcome-reward RL alone teaches long reasoning and self-reflection.

DeepSeek-R1 推理强化学习配方 2025 Advanced core

IN PLAIN WORDS

R1-Zero applies GRPO with rule-based rewards directly to a base model, and longer thinking and self-checking emerge; R1 adds cold-start data and multi-stage training, then distills reasoning into small models.

Used in: DeepSeek-R1, its distilled models and many open replications

TIMELINE · prerequisites → this → what builds on it

2022 Chain-of-Thou…2024 Group Relativ…2024 RL with Verif…2025 DeepSeek-R1 Reaso…

01Original paper

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

DeepSeek-AI, Daya Guo, Dejian Yang, et al. · 2025

arXiv ↗ ✓ Verified · arXiv API

02Where it sits

Learn the left column first; the right column builds on this one.

Learn first

DeepSeek-R1 Reasoning RL Recipe

Then you can learn

  • Nothing in the atlas builds on it yet

Related:Test-Time Compute ScalingKnowledge Distillation

Group Relative …RL with Verifia…Chain-of-Though…Test-Time Compu…Knowledge Disti… DeepSeek-R1 Reasoni…

Left: prerequisites · right: builds on this · dashed: related. Full map →

03Learning resources

Official docs, explainers, courses and reference code. All links checked.

04Where the course teaches it

On learning paths:Post-training & Reasoning Models

For AI / data

Data updated: AI algorithms & curriculum(UTC+8)