Skip to content
English

Switch theme

Discover▾

Not sure where to start? This week’s hottest software, models and stacks in three minutes.

AI Apps▾

AI software people use: from assistants like ChatGPT to tools for coding, video and workflows, picked by purpose.

For Agents▾

Software for AI: tools that let your agent (Claude Code, Codex, Cursor…) browse, read docs, run code and remember.

Models▾

Choose models, estimate cost, self-host: prices, rankings, benchmarks, free tiers and compute.

Solutions▾

A goal or an error message? Ready-made stacks, steps and fixes by scenario.

Learn▾

A systematic course from zero to the frontier, with an algorithm library, must-read papers and tutorials.

Frontier▾

Daily AI news, weekly highlights, the latest papers and how AI is changing every discipline.

// Course · stage 3 of 9

Deep Learning

Neural networks, backpropagation, optimisation and normalisation, from CNNs/RNNs to attention.

Start the first unit → All stages

4 unitsabout 44 hours32 algorithms

01Units in this stage

In order. Each unit has goals, algorithms, must-read papers, a project and a self-test.

01 · U30 Neural Networks & Backpropagation From neurons and multilayer perceptrons to backpropagation and activation functions. 10 h4 algorithms2 paperslesson ready 02 · U31 Training Deep Nets SGD/momentum/Adam/AdamW/Muon, learning-rate schedules, BatchNorm/LayerNorm/RMSNorm, dropout and residuals. 10 h10 algorithms4 papers 03 · U32 CNNs, RNNs and the Birth of Attention Convolutional networks, LSTMs, Seq2Seq, word vectors and Bahdanau attention. 10 h7 algorithms5 papers 04 · U33 Reinforcement Learning Basics MDPs, Q-learning, DQN, policy gradients, PPO and AlphaZero — the prerequisites for post-training and reasoning models. 14 h12 algorithms4 papers

02Algorithms you will meet

Algorithms Atlas →

PerceptronBackpropagationGELUAutoencoderStochastic Gradient Descent (SGD)AdamAdamW (Decoupled Weight Decay)Muon OptimizerBatch NormalizationLayer NormalizationRMSNormDropoutResidual Networks (ResNet)Weight Initialization (Xavier / He)Convolutional Neural Network (CNN)Long Short-Term Memory (LSTM)Sequence-to-Sequence LearningWord2VecAttention (Bahdanau)Gated Recurrent Unit (GRU)Q-LearningDeep Q-Network (DQN)Policy Gradient (REINFORCE)Proximal Policy Optimization (PPO)Soft Actor-Critic (SAC)AlphaGo / AlphaZero (Self-Play + MCTS)MuZeroActor-Critic & A3C/A2CTrust Region Policy Optimization (TRPO)DDPG / TD3 (Continuous Control)Conservative Q-Learning (CQL, Offline RL)Decision Transformer

Part of these routes: Algorithm Researchers · Domain Scientists

Data updated: AI algorithms & curriculum(UTC+8)