Skip to content
English

Switch theme

Discover▾

Not sure where to start? This week’s hottest software, models and stacks in three minutes.

AI Apps▾

AI software people use: from assistants like ChatGPT to tools for coding, video and workflows, picked by purpose.

For Agents▾

Software for AI: tools that let your agent (Claude Code, Codex, Cursor…) browse, read docs, run code and remember.

Models▾

Choose models, estimate cost, self-host: prices, rankings, benchmarks, free tiers and compute.

Solutions▾

A goal or an error message? Ready-made stacks, steps and fixes by scenario.

Learn▾

A systematic course from zero to the frontier, with an algorithm library, must-read papers and tutorials.

Frontier▾

Daily AI news, weekly highlights, the latest papers and how AI is changing every discipline.

// Stage 3 · Deep Learning

CNNs, RNNs and the Birth of Attention

Convolutional networks, LSTMs, Seq2Seq, word vectors and Bahdanau attention.

What you will learn ↓ Code & exercises ↓

about 10 hours7 algorithms5 paperslesson text in progress

01Goals

Do these first: Training Deep Nets

02Algorithms to master

Each card has the original paper, prerequisites and resources.

Convolutional Neural Network (CNN) Slides small learned filters to detect local patterns, composed layer by layer. 1998core Residual Networks (ResNet) Skip connections let signals bypass layers, making very deep nets trainable. 2015core Long Short-Term Memory (LSTM) A gated recurrent network that preserves long-range information. 1997core Sequence-to-Sequence Learning An encoder reads a sequence and a decoder generates another. 2014core Word2Vec Learns word vectors by predicting words from context. 2013core Attention (Bahdanau) Lets the decoder look back at the most relevant input positions. 2014core Gated Recurrent Unit (GRU) A leaner gated RNN than LSTM, with two gates for remembering and forgetting. 2014core

03Must-read papers

04Courses & videos

05Hands-on: project, code & exercises

Free, official or author-published pages. Most run in the browser or on a free Colab GPU.

PROJECT

Do sentiment classification of film reviews with a CNN and an LSTM, then visualise where each model looks with Grad-CAM or attention weights.

  1. 1
    Georgia Tech：CNN Explainer ↗Interactive

    Inspect convolution, ReLU and pooling outputs layer by layer interactively.

  2. 2
    karpathy/makemore ↗Reference code

    Generate names with a character model, swapping in MLP, RNN and GRU.

  3. 3
    zh.d2l.ai ↗Books

    Run the CNN and RNN chapters’ code.

06Self-test

Answer in your head, then open to check.

Why do convolution layers have fewer parameters than dense layers?

The same kernel is shared across all positions.

What is the Seq2Seq information bottleneck?

The whole sentence is squeezed into one fixed-length vector.

What property do Word2Vec vectors have?

Words with similar meaning get similar vectors, and analogies work as vector arithmetic.

On these routes: Algorithm Researchers

Data updated: AI algorithms & curriculum(UTC+8)