TOPIC · VISION · 21 PAPERS

Vision & 3D

LLMs Reasoning Alignment Agents Multimodal Visual generation Vision & 3D Robotics & embodied AI Efficient training & inference Safety & interpretability AI for Science Code & SWE Benchmarks & data Reinforcement learning

Last 30 days 21

#10 ▲296 ★1.3k ❝0 2026-09-27

VisionHOPE: Visual Backbones as Self-Modifying Learning Systems

VisionHOPE turns a visual backbone into a self-modifying learner whose memory and update rules co-evolve within each image.

Mininglamp Technology · Siran Peng, Tianshuo Zhang, Tianyu Fu +8

Vision & 3D arXiv Code HF

#14 ▲310 ★140 ❝2 2026-09-30

GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives

GroundingPI is a 4B grounding foundation model that outputs points and boxes as tokens to give robots fast, precise targeting.

XPENG AI · Qize Yu, Lianrui Fan, Boyu Chen +23

Robotics & embodied AI Vision & 3D arXiv Code HF

#49 ▲131 ★523 ❝0 2026-10-14

InfiniSplat v2: Analyzing and Improving Feed-Forward 3DGS from Any Views

InfiniSplat v2 analyses and improves feed-forward 3D Gaussian reconstruction for better rendering under large viewpoint changes.

zju3dv · Yongzhen Hu, Hao Yu, Jiawei Wang +7

Visual generation Vision & 3D arXiv Code HF

#50 ▲78 ★526 ❝0 2026-09-21

GAE: Learning a Geometry-Native Latent Space for 3D-Consistent World Generation

GAE reparameterises geometry foundation-model features into a compact latent space so generated worlds stay 3D-consistent.

ARC Lab, Tencent · Jiahao Lu, Minghao Yin, Wenbo Hu +5

Visual generation Vision & 3D arXiv Code HF

#52 ▲133 ★105 ❝0 2026-10-13

Urbex: Agentic Spatial Grounding for City-Scale 3D Scenes

Urbex treats city-scale 3D grounding as active search by a VLM agent that zooms and changes views, optimised with RL.

alibaba · Yu Wang, Rui Dai, Wei Chen +5

Agents Vision & 3D Reinforcement learning arXiv Code HF

#58 ▲94 ★78 ❝4 2026-09-30

GroundAnything: Reconciling Parallel Decoding with Precise Visual Grounding at Flash Speed

GroundAnything decodes grounding outputs in parallel with bidirectional diffusion, keeping precision while being much faster.

XPENG AI · Qize Yu, Lianrui Fan, Bowen Ping +19

Vision & 3D Efficient training & inference arXiv Code HF

#93 ▲170 ★18 2026-10-19

EgoXperience: Learning World-Grounded Egocentric Representations from Human Experience

EgoXperience jointly reconstructs observer motion, scene geometry and hand-object interaction from egocentric video, with an auto-annotation engine and benchmark.

Ropedia · Xinhao Ji, Hui En Pang, Hao Li +12

Vision & 3D Robotics & embodied AI Benchmarks & data arXiv Code HF

#107 ▲156 ★13 ❝0 2026-10-19

Holi-World: Building Holistic World Intelligence from Human-Ego Experience

Holi-World is an ecosystem for learning world intelligence from human egocentric experience, from capture to evaluation.

Ropedia · Hao Li, Xiyuan Zheng, Yuanyuan Gao +7

Vision & 3D Benchmarks & data arXiv Code HF

#108 ▲75 ★287 ❝0 2026-10-08

LeWAM: End-to-End World and Action Modeling with JEPAs

LeWAM is an end-to-end JEPA world-action model that supports both direct policy execution and efficient planning.

LeWAM · Minghao Fu, Tavis Siebert, Eryk Halicki +1

Robotics & embodied AI Vision & 3D arXiv Code HF

#134 ▲34 ★178 ❝4 2026-10-02

4DCodeBench: Benchmarking Agents on Inverse Graphics of Dynamic Scenes

4DCodeBench asks agents to reconstruct dynamic scenes from video as executable graphics programs.

4DCodeBench · Ruihong Shen, Žiga Kovačič, Peter Kulits +6

Benchmarks & data Code & SWE Vision & 3D arXiv Code HF

#171 ▲129 ❝0 2026-09-28

LEGO-Anything: Coding Agents for 3D Scene Reconstruction

LEGO-Anything has a coding agent iteratively write Blender code to reconstruct editable 3D scenes from a single image.

Amazon Web Services · Xirui Li, Peng Shi, Mingwen Dong +7

Code & SWE Vision & 3D Agents arXiv HF

#191 ▲56 ★12 ❝2 2026-09-21

All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Experts

A script-aware mixture-of-experts gives one multilingual scene-text recogniser that is simpler than per-language models and lighter than VLMs.

Fudan University · Xingsong Ye, Yongkun Du, Jiaxin Zhang +6

Vision & 3D Efficient training & inference arXiv Code HF

#198 ▲57 ★17 ❝0 2026-09-29

OmniTaskonomy: When Does Visual Generation Improve Visual Understanding?

Studies when visual generation training improves understanding, finding image-to-image training helps under the right recipe.

UC Berkeley · Jiaxin Ge, Yiming Qin, Ji Xie +13

Multimodal Vision & 3D arXiv Code HF

#210 ▲62 ★27 ❝0 2026-10-16

Scene-Designer: Learning Design Intelligence for Agentic 3D Scene Generation

Scene-Designer learns design intelligence from design and critique experience to generate coherent 3D indoor scenes from text.

ZJU-OmniAI · Xuanyu Liu, Hongyan Feng, Miao Pan +5

Agents Vision & 3D arXiv Code HF

#248 ▲45 ★45 ❝0 2026-10-16

Xiaomi-Lens-0 Technical Report

Xiaomi-Lens-0 is a 4B MLLM on Qwen3.5 that predicts segmentation masks from its own visual representations.

SeerRay-Lab · Pei Fu, Yike Liu, Yue Sun +13

Vision & 3D Multimodal arXiv Code HF

#252 ▲49 ★41 ❝0 2026-10-07

Tetris3D: 3D Scene Generation With Objects That Fit Together

Tetris3D conditions each object on its neighbours' geometry and physical relations so single-image 3D scenes fit together.

KAIST AI · Jaeyeong Kim, Jinhyuk Jang, Jongmin Lee +2

Vision & 3D arXiv Code HF

#260 ▲45 ★19 ❝1 2026-10-07

RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learning

RLHND uses a video foundation model to estimate hand pose and touch from egocentric video, making human videos more useful for robots.

RLWRLD · Seungjun Moon, Subin Jeon, Sangwoo Kim +2

Robotics & embodied AI Vision & 3D arXiv Code HF

#264 ▲60 ★26 ❝0 2026-10-01

EditHero: A Benchmark for Long-Horizon Part-Level 3D Editing and Vibe Modeling

EditHero is a benchmark for long-horizon, part-level 3D editing, checking that each revision changes only what was asked.

Affiliation unverified · Ruihan Yu, Yu-Ju Tsai, Muyao Niu +9

Vision & 3D Benchmarks & data arXiv Code HF

#289 ▲26 ★31 ❝0 2026-10-19

InfiniDream: Open-Ended Photorealistic 3D Worlds Through Procedural Generation

InfiniDream has a VLM drive procedural algorithms to generate open-ended, editable photorealistic 3D assets and large worlds.

Alaya Lab · Yi-Chuan Huang, Hao-Jen Chien, Zheng-Hui Huang +3

Vision & 3D Code & SWE arXiv Code HF

#302 ▲22 ❝0 2026-10-20

Joints, Camera, Action! Co-Generating 3D Motion and Video for Arbitrary Rigs

Co-generates video, replayable 3D motion for any rig and a registering camera, turning video-model motion into usable 3D animation.

NVIDIA · Noam Rotstein, Yoad Tewel, Chen Tessler +5

Visual generation Vision & 3D arXiv HF

#305 ▲26 ❝0 2026-10-03

Super-Resolution in The Right Latent Space: A Frozen Vision-Foundation Substrate

Argues real-world super-resolution works best in a frozen vision-foundation feature space rather than reconstruction latents or pixels.

RTP-LLM · Wanzhou Lei, Cuifeng Shen, Yanjin He +6

Vision & 3D Visual generation arXiv HF

Search this topic in the archive →