Multimodal AI
How Vision-Language Models See
Image encoders, patches, projection layers and multimodal training.
Advanced 20 min For: Developers / Researchers ✎ In progress
✎ This lesson is still being written. Below is the planned outline; it is not indexed by search engines yet.
What this lesson will cover
- ViT and image patches
- CLIP-style contrastive learning
- Connecting vision to an LLM
- OCR, charts and screens