Skip to content
English

Switch theme

// ⬡ Deep Learning Foundations

Dropout

Randomly drops neurons during training to prevent overfitting.

2012 Beginner core

IN PLAIN WORDS

Each step zeroes random units so the network cannot rely on any single one — like averaging many sub-networks.

Used in: CNNs, MLPs, some Transformers

TIMELINE · prerequisites → this → what builds on it

1986 Backpropagati…2012 Dropout

01Original paper

Improving neural networks by preventing co-adaptation of feature detectors

Geoffrey E. Hinton, Nitish Srivastava, Alex Krizhevsky, et al. · 2012

arXiv ↗ ✓ Verified · arXiv API

02Where it sits

Learn the left column first; the right column builds on this one.

Learn first

Dropout

Then you can learn

  • Nothing in the atlas builds on it yet

Related:Batch Normalization

BackpropagationBatch Normaliza… Dropout

Left: prerequisites · right: builds on this · dashed: related. Full map →

03Learning resources

Official docs, explainers, courses and reference code. All links checked.

04Where the course teaches it

On learning paths:Zero to Deep Learning

For AI / data

Data updated: AI algorithms & curriculum(UTC+8)