A Step Toward World Models: A Survey on Robotic Manipulation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Peng-Fei, Cheng, Ying, Sun, Xiaofan, Wang, Shijie, Li, Fengling, Zhu, Lei, Shen, Heng Tao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915608406261760
author Zhang, Peng-Fei
Cheng, Ying
Sun, Xiaofan
Wang, Shijie
Li, Fengling
Zhu, Lei
Shen, Heng Tao
author_facet Zhang, Peng-Fei
Cheng, Ying
Sun, Xiaofan
Wang, Shijie
Li, Fengling
Zhu, Lei
Shen, Heng Tao
contents Autonomous agents are increasingly expected to operate in complex, dynamic, and uncertain environments, performing tasks such as manipulation, navigation, and decision-making. Achieving these capabilities requires agents to understand the underlying mechanisms and dynamics of the world, moving beyond reactive control or simple replication of observed states. This motivates the development of world models as internal representations that encode environmental states, capture dynamics, and support prediction, planning, and reasoning. Despite growing interest, the definition, scope, architectures, and essential capabilities of world models remain ambiguous. In this survey, we go beyond prescribing a fixed definition and limiting our scope to methods explicitly labeled as world models. Instead, we examine approaches that exhibit the core capabilities of world models through a review of methods in robotic manipulation. We analyze their roles across perception, prediction, and control, identify key challenges and solutions, and distill the core components, capabilities, and functions that a fully realized world model should possess. Building on this analysis, we aim to motivate further development toward generalizable and practical world models for robotics.
format Preprint
id arxiv_https___arxiv_org_abs_2511_02097
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Step Toward World Models: A Survey on Robotic Manipulation
Zhang, Peng-Fei
Cheng, Ying
Sun, Xiaofan
Wang, Shijie
Li, Fengling
Zhu, Lei
Shen, Heng Tao
Robotics
Computer Vision and Pattern Recognition
Autonomous agents are increasingly expected to operate in complex, dynamic, and uncertain environments, performing tasks such as manipulation, navigation, and decision-making. Achieving these capabilities requires agents to understand the underlying mechanisms and dynamics of the world, moving beyond reactive control or simple replication of observed states. This motivates the development of world models as internal representations that encode environmental states, capture dynamics, and support prediction, planning, and reasoning. Despite growing interest, the definition, scope, architectures, and essential capabilities of world models remain ambiguous. In this survey, we go beyond prescribing a fixed definition and limiting our scope to methods explicitly labeled as world models. Instead, we examine approaches that exhibit the core capabilities of world models through a review of methods in robotic manipulation. We analyze their roles across perception, prediction, and control, identify key challenges and solutions, and distill the core components, capabilities, and functions that a fully realized world model should possess. Building on this analysis, we aim to motivate further development toward generalizable and practical world models for robotics.
title A Step Toward World Models: A Survey on Robotic Manipulation
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.02097