MWM: Mobile World Models for Action-Conditioned Consistent Prediction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yan, Han, Xiang, Zishang, Zhang, Zeyu, Tang, Hao
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910045964337152
author Yan, Han
Xiang, Zishang
Zhang, Zeyu
Tang, Hao
author_facet Yan, Han
Xiang, Zishang
Zhang, Zeyu
Tang, Hao
contents World models enable planning in imagined future predicted space, offering a promising framework for embodied navigation. However, existing navigation world models often lack action-conditioned consistency, so visually plausible predictions can still drift under multi-step rollout and degrade planning. Moreover, efficient deployment requires few-step diffusion inference, but existing distillation methods do not explicitly preserve rollout consistency, creating a training-inference mismatch. To address these challenges, we propose MWM, a mobile world model for planning-based image-goal navigation. Specifically, we introduce a two-stage training framework that combines structure pretraining with Action-Conditioned Consistency (ACC) post-training to improve action-conditioned rollout consistency. We further introduce Inference-Consistent State Distillation (ICSD) for few-step diffusion distillation with improved rollout consistency. Our experiments on benchmark and real-world tasks demonstrate consistent gains in visual fidelity, trajectory accuracy, planning success, and inference efficiency. Code: https://github.com/AIGeeksGroup/MWM. Website: https://aigeeksgroup.github.io/MWM.
format Preprint
id arxiv_https___arxiv_org_abs_2603_07799
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MWM: Mobile World Models for Action-Conditioned Consistent Prediction
Yan, Han
Xiang, Zishang
Zhang, Zeyu
Tang, Hao
Computer Vision and Pattern Recognition
Robotics
World models enable planning in imagined future predicted space, offering a promising framework for embodied navigation. However, existing navigation world models often lack action-conditioned consistency, so visually plausible predictions can still drift under multi-step rollout and degrade planning. Moreover, efficient deployment requires few-step diffusion inference, but existing distillation methods do not explicitly preserve rollout consistency, creating a training-inference mismatch. To address these challenges, we propose MWM, a mobile world model for planning-based image-goal navigation. Specifically, we introduce a two-stage training framework that combines structure pretraining with Action-Conditioned Consistency (ACC) post-training to improve action-conditioned rollout consistency. We further introduce Inference-Consistent State Distillation (ICSD) for few-step diffusion distillation with improved rollout consistency. Our experiments on benchmark and real-world tasks demonstrate consistent gains in visual fidelity, trajectory accuracy, planning success, and inference efficiency. Code: https://github.com/AIGeeksGroup/MWM. Website: https://aigeeksgroup.github.io/MWM.
title MWM: Mobile World Models for Action-Conditioned Consistent Prediction
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2603.07799