Skip to content
English

Switch theme

Multimodal AI

How Vision-Language Models See

Image encoders, patches, projection layers and multimodal training.

Advanced 20 min For: Developers / Researchers ✎ In progress

✎ This lesson is still being written. Below is the planned outline; it is not indexed by search engines yet.

What this lesson will cover

  1. ViT and image patches
  2. CLIP-style contrastive learning
  3. Connecting vision to an LLM
  4. OCR, charts and screens

Related AI news

Links go to the original publishers.

Part of these paths

Data updated: Learn AI curriculum · Lesson news(UTC+8)