Saved in:
Bibliographic Details
Main Authors: Zhang, Zhiwei, Zhang, Hui, Huang, Kaihong, Shi, Chenghao, Lu, Huimin
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2511.11011
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918256002990080
author Zhang, Zhiwei
Zhang, Hui
Huang, Kaihong
Shi, Chenghao
Lu, Huimin
author_facet Zhang, Zhiwei
Zhang, Hui
Huang, Kaihong
Shi, Chenghao
Lu, Huimin
contents World models enable robots to conduct counterfactual reasoning in physical environments by predicting future world states. While conventional approaches often prioritize pixel-level reconstruction of future scenes, such detailed rendering is computationally intensive and unnecessary for planning tasks like navigation. We therefore propose that prediction and planning can be efficiently performed directly within a latent space of high-level semantic representations. To realize this, we introduce the Representative Latent space Navigation World Model (ReL-NWM). Rather than relying on reconstructionoriented latent embeddings, our method leverages a pre-trained representation encoder, DINOv3, and incorporates specialized mechanisms to effectively integrate action signals and historical context within this representation space. By operating entirely in the latent domain, our model bypasses expensive explicit reconstruction and achieves highly efficient navigation planning. Experiments show state-of-the-art trajectory prediction and image-goal navigation performance on multiple benchmarks. Additionally, we demonstrate real-world applicability by deploying the system on a Unitree G1 humanoid robot, confirming its efficiency and robustness in practical navigation scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2511_11011
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Efficient Image-Goal Navigation with Representative Latent World Model
Zhang, Zhiwei
Zhang, Hui
Huang, Kaihong
Shi, Chenghao
Lu, Huimin
Robotics
World models enable robots to conduct counterfactual reasoning in physical environments by predicting future world states. While conventional approaches often prioritize pixel-level reconstruction of future scenes, such detailed rendering is computationally intensive and unnecessary for planning tasks like navigation. We therefore propose that prediction and planning can be efficiently performed directly within a latent space of high-level semantic representations. To realize this, we introduce the Representative Latent space Navigation World Model (ReL-NWM). Rather than relying on reconstructionoriented latent embeddings, our method leverages a pre-trained representation encoder, DINOv3, and incorporates specialized mechanisms to effectively integrate action signals and historical context within this representation space. By operating entirely in the latent domain, our model bypasses expensive explicit reconstruction and achieves highly efficient navigation planning. Experiments show state-of-the-art trajectory prediction and image-goal navigation performance on multiple benchmarks. Additionally, we demonstrate real-world applicability by deploying the system on a Unitree G1 humanoid robot, confirming its efficiency and robustness in practical navigation scenarios.
title Efficient Image-Goal Navigation with Representative Latent World Model
topic Robotics
url https://arxiv.org/abs/2511.11011