// ✦ Diffusion, Flow Matching & Generative Models
ControlNet
Adds precise spatial control (edges, pose, depth) to diffusion models.
2023 Intermediate core
IN PLAIN WORDS
Clone the U-Net encoder to read a control image and connect it via zero-initialized convolutions with the original frozen. Users control layout with sketches or poses.
Used in: Stable Diffusion ecosystem, design tools
01Original paper
Adding Conditional Control to Text-to-Image Diffusion Models
Lvmin Zhang, Anyi Rao, Maneesh Agrawala · 2023
arXiv ↗ ✓ Verified · arXiv API
02Where it sits
Learn the left column first; the right column builds on this one.
Learn first
Then you can learn
- Nothing in the atlas builds on it yet
Related:LoRA (Low-Rank Adaptation)
Left: prerequisites · right: builds on this · dashed: related. Full map →
03Learning resources
Official docs, explainers, courses and reference code. All links checked.
04Where the course teaches it
For AI / data
- Verification: verified, checked 2026-10-21.
- JSON: /api/learn/algorithms.json (id:
controlnet)