arXiv 2609.38597 · cs.CV · 2026-09-29
PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation
Cong Wei, Xuanchi Ren, Bryan Chu, Weiming Ren, Huan Ling, Jiahui Huang, Laura Leal-Taixé, Sanja Fidler and 3 more
NVIDIA
In latest · #127 Added on 2026-10-21
One-line takeaway
PixelUMM unifies image and video understanding and generation directly in pixel space without a visual encoder.
PixelUMM 不用视觉编码器，直接在像素空间统一图像和视频的理解与生成。
Read on arXiv PDF Hugging Face discussion Code Project page
Topics & disciplines
More on Multimodal
- MJev-Spatial: System One Spatial Intelligence via Native Attention Matching ▲560
- LoopVL: Recurrent Visual Intelligence ▲417
- VideoJev: System One Model for Video Understanding and Interaction ▲375
- S-Space: Exploring Spatial Workspace in Multimodal Language Models ▲270
- UniEvo-VL: An On-policy Self-Distillation Training Recipe for Multimodal Model Self-improvement ▲266
About this data
Metadata from the arXiv API (verified); upvotes from Hugging Face Daily Papers; citations from Semantic Scholar. Last refreshed 2026-10-22.
The takeaway is written by AIMap from the abstract; the abstract itself is not reproduced — read the original.