Skip to content
English

Switch theme

// ⬡ Deep Learning Foundations

Residual Networks (ResNet)

Skip connections let signals bypass layers, making very deep nets trainable.

残差网络 2015 Foundational core

IN PLAIN WORDS

Each block learns a residual: output = input + F(input), so gradients flow through the shortcut. Depth jumped to 100+ layers; every Transformer sublayer uses it.

Used in: Vision backbones; residual paths in Transformers

TIMELINE · prerequisites → this → what builds on it

1998 Convolutional…2015 Batch Normali…2015 Residual Networks…2015 Faster R-CNN …2017 Transformer &…2020 SimCLR

01Original paper

Deep Residual Learning for Image Recognition

Kaiming He, Xiangyu Zhang, Shaoqing Ren, et al. · 2015

arXiv ↗ ✓ Verified · arXiv API

02Where it sits

Learn the left column first; the right column builds on this one.

Convolutional N…Batch Normaliza…Transformer & S…SimCLRFaster R-CNN (O… Residual Networks (…

Left: prerequisites · right: builds on this · dashed: related. Full map →

03Learning resources

Official docs, explainers, courses and reference code. All links checked.

04Where the course teaches it

On learning paths:Zero to Deep Learning

For AI / data

Data updated: AI algorithms & curriculum(UTC+8)