Schrödinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: He, Yu, Huang, Da, Liu, Zhenyang, Gu, Zixiao, Sun, Qiang, Ye, Guangnan, Fu, Yanwei, Jiang, Yu-Gang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915885441089536
author He, Yu
Huang, Da
Liu, Zhenyang
Gu, Zixiao
Sun, Qiang
Ye, Guangnan
Fu, Yanwei
Jiang, Yu-Gang
author_facet He, Yu
Huang, Da
Liu, Zhenyang
Gu, Zixiao
Sun, Qiang
Ye, Guangnan
Fu, Yanwei
Jiang, Yu-Gang
contents Zero-shot object navigation (ZSON) requires robots to locate target objects in unseen environments without task-specific fine-tuning or pre-built maps, a capability crucial for service and household robotics. Existing methods perform well in simulation but struggle in realistic, cluttered environments where heavy occlusions and latent hazards make large portions of the scene unobserved. These approaches typically act on a single inferred scene, making them prone to overcommitment and unsafe behavior under uncertainty. To address these challenges, we propose Schrödinger's Navigator, a belief-aware framework that explicitly reasons over multiple trajectory-conditioned imagined 3D futures at inference time. A trajectory-conditioned 3D world model generates hypothetical observations along candidate paths, maintaining a superposition of plausible scene realizations. An adaptive, occluder-aware trajectory sampling strategy focuses imagination on uncertain regions, while a Future-Aware Value Map (FAVM) aggregates imagined futures to guide robust, proactive action selection. Evaluations in simulation and on a physical Go2 quadruped robot demonstrate that Schrödinger's Navigator outperforms strong ZSON baselines, achieving more robust self-localization, object localization, and safe navigation under severe occlusions and latent hazards. These results highlight the effectiveness of reasoning over imagined 3D futures as a scalable and generalizable strategy for zero-shot navigation in uncertain real-world environments.
format Preprint
id arxiv_https___arxiv_org_abs_2512_21201
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Schrödinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation
He, Yu
Huang, Da
Liu, Zhenyang
Gu, Zixiao
Sun, Qiang
Ye, Guangnan
Fu, Yanwei
Jiang, Yu-Gang
Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Zero-shot object navigation (ZSON) requires robots to locate target objects in unseen environments without task-specific fine-tuning or pre-built maps, a capability crucial for service and household robotics. Existing methods perform well in simulation but struggle in realistic, cluttered environments where heavy occlusions and latent hazards make large portions of the scene unobserved. These approaches typically act on a single inferred scene, making them prone to overcommitment and unsafe behavior under uncertainty. To address these challenges, we propose Schrödinger's Navigator, a belief-aware framework that explicitly reasons over multiple trajectory-conditioned imagined 3D futures at inference time. A trajectory-conditioned 3D world model generates hypothetical observations along candidate paths, maintaining a superposition of plausible scene realizations. An adaptive, occluder-aware trajectory sampling strategy focuses imagination on uncertain regions, while a Future-Aware Value Map (FAVM) aggregates imagined futures to guide robust, proactive action selection. Evaluations in simulation and on a physical Go2 quadruped robot demonstrate that Schrödinger's Navigator outperforms strong ZSON baselines, achieving more robust self-localization, object localization, and safe navigation under severe occlusions and latent hazards. These results highlight the effectiveness of reasoning over imagined 3D futures as a scalable and generalizable strategy for zero-shot navigation in uncertain real-world environments.
title Schrödinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation
topic Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.21201