Saved in:
Bibliographic Details
Main Authors: Wang, Fangyuan, Wang, Ziyuan, Pei, Guorui, Zhang, Mengshi, Liang, Canxi, Hu, Jun, Li, Zhongxuan, Wu, Jinsong, Han, Ning, Zhang, Zeqing, Qi, Jiaming, Wu, Hongmin, Zhang, Shiyao, Zheng, Pai, Pan, Jia, Navarro-Alarcon, David, Liu, Sichao, Zhou, Peng
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2606.00113
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Robotic manipulation depends on the ability to anticipate how actions reshape objects, contacts, and scene geometry before execution. Learned world models provide this capability by predicting task-relevant future evolution under robot intervention, yet the term now spans latent dynamics models, action-conditioned video generators, three- and four-dimensional scene predictors, physics-informed simulators, and predictive modules inside vision-language-action systems. This breadth has fragmented the literature and obscured the design choices that matter for manipulation. We survey world models for robotic manipulation through three questions: what future representation is predicted, how prediction is connected to action, and when prediction is used in the robot-learning pipeline. We operationally define a world model as an action-conditioned predictive system and distinguish it from perception modules, inverse models, policies, rewards, and value functions. We then organize existing work into five representation families, develop a functional taxonomy that separates integrated prediction-action models from explicit predictive planners, and characterize infrastructure roles including synthetic experience generation, candidate filtering, search-based evaluation, learned environments, and outcome verification. We further map these roles across pretraining, post-training, and inference adaptation, review 34 manipulation datasets, and synthesize evaluation protocols for predictive fidelity, task performance, and simulator reliability. This survey shows that world models are evolving from task-specific dynamics predictors into predictive infrastructure for robot learning, while exposing open challenges in contact modeling, hallucination control, action alignment, and benchmarking under closed-loop use.