Skip to content
English

Switch theme

// ◉ Multimodal & Vision

CLIP (Contrastive Language–Image Pretraining)

Aligns images and text in one embedding space from 400M pairs.

CLIP 图文对比学习 2021 Foundational core

IN PLAIN WORDS

Image and text encoders are trained so matched pairs in a batch score high and mismatched ones low. It enables zero-shot classification and text-image search, and conditions text-to-image models.

Used in: Stable Diffusion text encoder, image search

TIMELINE · prerequisites → this → what builds on it

2018 Contrastive L…2020 Vision Transf…2021 CLIP (Contrastive…2021 Latent Diffus…2022 Flamingo2023 SigLIP (Sigmo…2023 Visual Instru…

01Original paper

Learning Transferable Visual Models From Natural Language Supervision

Alec Radford, Jong Wook Kim, Chris Hallacy, et al. · 2021

arXiv ↗ ✓ Verified · arXiv API

02Where it sits

Learn the left column first; the right column builds on this one.

Vision Transfor…Contrastive Lea…Latent Diffusio…SigLIP (Sigmoid…Visual Instruct…Flamingo CLIP (Contrastive L…

Left: prerequisites · right: builds on this · dashed: related. Full map →

03Learning resources

Official docs, explainers, courses and reference code. All links checked.

04Where the course teaches it

On learning paths:Generative Models & Frontier Research

For AI / data

Data updated: AI algorithms & curriculum(UTC+8)