Reasoning about the Unseen for Efficient Outdoor Object Navigation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Xie, Quanting, Zhang, Tianyi, Xu, Kedi, Johnson-Roberson, Matthew, Bisk, Yonatan
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914962027315200
author Xie, Quanting
Zhang, Tianyi
Xu, Kedi
Johnson-Roberson, Matthew
Bisk, Yonatan
author_facet Xie, Quanting
Zhang, Tianyi
Xu, Kedi
Johnson-Roberson, Matthew
Bisk, Yonatan
contents Robots should exist anywhere humans do: indoors, outdoors, and even unmapped environments. In contrast, the focus of recent advancements in Object Goal Navigation(OGN) has targeted navigating in indoor environments by leveraging spatial and semantic cues that do not generalize outdoors. While these contributions provide valuable insights into indoor scenarios, the broader spectrum of real-world robotic applications often extends to outdoor settings. As we transition to the vast and complex terrains of outdoor environments, new challenges emerge. Unlike the structured layouts found indoors, outdoor environments lack clear spatial delineations and are riddled with inherent semantic ambiguities. Despite this, humans navigate with ease because we can reason about the unseen. We introduce a new task OUTDOOR, a new mechanism for Large Language Models (LLMs) to accurately hallucinate possible futures, and a new computationally aware success metric for pushing research forward in this more complex domain. Additionally, we show impressive results on both a simulated drone and physical quadruped in outdoor environments. Our agent has no premapping and our formalism outperforms naive LLM-based approaches
format Preprint
id arxiv_https___arxiv_org_abs_2309_10103
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Reasoning about the Unseen for Efficient Outdoor Object Navigation
Xie, Quanting
Zhang, Tianyi
Xu, Kedi
Johnson-Roberson, Matthew
Bisk, Yonatan
Robotics
Artificial Intelligence
Robots should exist anywhere humans do: indoors, outdoors, and even unmapped environments. In contrast, the focus of recent advancements in Object Goal Navigation(OGN) has targeted navigating in indoor environments by leveraging spatial and semantic cues that do not generalize outdoors. While these contributions provide valuable insights into indoor scenarios, the broader spectrum of real-world robotic applications often extends to outdoor settings. As we transition to the vast and complex terrains of outdoor environments, new challenges emerge. Unlike the structured layouts found indoors, outdoor environments lack clear spatial delineations and are riddled with inherent semantic ambiguities. Despite this, humans navigate with ease because we can reason about the unseen. We introduce a new task OUTDOOR, a new mechanism for Large Language Models (LLMs) to accurately hallucinate possible futures, and a new computationally aware success metric for pushing research forward in this more complex domain. Additionally, we show impressive results on both a simulated drone and physical quadruped in outdoor environments. Our agent has no premapping and our formalism outperforms naive LLM-based approaches
title Reasoning about the Unseen for Efficient Outdoor Object Navigation
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2309.10103