Skip to content
English

Switch theme

// ⌕ RAG & Vector Retrieval

Contrastive Learning (InfoNCE)

Learns embeddings by pulling positives together and pushing negatives apart.

对比学习与 InfoNCE 2018 Intermediate core

IN PLAIN WORDS

InfoNCE classifies the true pair among many negatives. It is the shared objective behind CLIP, SimCLR, sentence embeddings and retrievers.

Used in: Training embedding and retrieval models

TIMELINE · prerequisites → this → what builds on it

1958 Logistic Regr…2018 Contrastive Learn…2019 Sentence Embe…2020 Dense Passage…2020 SimCLR2020 wav2vec 2.02021 CLIP (Contras…

01Original paper

Representation Learning with Contrastive Predictive Coding

Aaron van den Oord, Yazhe Li, Oriol Vinyals · 2018

arXiv ↗ ✓ Verified · arXiv API

02Where it sits

Learn the left column first; the right column builds on this one.

Logistic Regres…CLIP (Contrasti…Sentence Embedd…Dense Passage R…SimCLRwav2vec 2.0 Contrastive Learnin…

Left: prerequisites · right: builds on this · dashed: related. Full map →

03Learning resources

Official docs, explainers, courses and reference code. All links checked.

04Where the course teaches it

For AI / data

Data updated: AI algorithms & curriculum(UTC+8)