arXiv 2610.31668 · cs.CV · 2026-10-22
Reading, Writing, Sharing, and Interacting with the World through Video
Shengqiong Wu, Meng Luo, Bobo Li, Ziwei Liu, Shuicheng Yan, Ming-Hsuan Yang, Philip Torr, Hao Fei
University of Oxford
One-line takeaway
This survey unifies video understanding and generation through world modeling, focusing on four operations: reading, writing, sharing, and interaction, shifting from clip-level recognition to persistent, causal state modeling.
论文从世界建模视角系统梳理了视频理解与生成的四大核心操作:阅读、写作、共享和交互,强调从片段识别转向对持久状态和因果一致性的建模。
Key points
This survey presents a unifying framework for video foundation models through world modeling, organizing the literature around four operations: reading, writing, sharing, and interacting. It highlights a shift from clip-level perception to persistent world states, controllable evolution, and causal validity, emphasizing evaluation via interaction and downstream decisions.
- Proposes world modeling as a unifying lens for video understanding and generation.
- Organizes literature into four operations: reading, writing, sharing, and interaction.
- Shifts emphasis from clip-level recognition to persistent, causally valid world states.
- Highlights evaluation via interaction and downstream decision-making as key for validity.
Written only from the official arXiv abstract by an open-source model, then checked automatically (every number and name must appear in the abstract). The paper is authoritative.
Read on arXiv PDF Hugging Face discussion Code Project page
Topics & disciplines
More on Visual generation
- StreamEval: Evaluating Interactive Streaming Video Generation Models ▲649
- MaLiang-Harness: A Programmable Path to Image and Video Generation ▲367
- Any Time, Any Space: A World-State-Centric Framework for Agentic Video Generation ▲364
- DiffusionART: Efficient, Stable and Scalable Reinforcement of Diffusion Models ▲325
- Making MLLM Latents Matter: Factor-Aware Predictive Learning for Cinematic Video Generation ▲200
More on Benchmarks & data
- Spectral-Spatial Interpretation 2026-10-15 · ▲753
- Has GPT-6-Astra Achieved Embodied Intelligence? 2026-10-15 · ▲421
- BizAgentBench: Unveiling Hidden Challenges in Deploying Long-Horizon Agents for Real-World Business 2026-10-14 · ▲388
- RealCompanion: Benchmarking Human Understanding from Reasoning over Longitudinal Real-World Conversations 2026-10-01 · ▲287
- FDE-Gym: The Last Mile of AI Delivery 2026-10-15 · ▲270
About this data
Metadata from the arXiv API (verified); upvotes from Hugging Face Daily Papers; citations from Semantic Scholar. Last refreshed 2026-10-22.
The takeaway is written by AIMap from the abstract; the abstract itself is not reproduced — read the original.