Open-Architecture End-to-End System for Real-World Autonomous Robot Navigation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Devarakonda, Venkata Naren, Kaypak, Ali Umut, Goswami, Raktim Gautam, Patel, Naman, Khorrambakht, Rooholla, Krishnamurthy, Prashanth, Khorrami, Farshad
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917426702057472
author Devarakonda, Venkata Naren
Kaypak, Ali Umut
Goswami, Raktim Gautam
Patel, Naman
Khorrambakht, Rooholla
Krishnamurthy, Prashanth
Khorrami, Farshad
author_facet Devarakonda, Venkata Naren
Kaypak, Ali Umut
Goswami, Raktim Gautam
Patel, Naman
Khorrambakht, Rooholla
Krishnamurthy, Prashanth
Khorrami, Farshad
contents Enabling robots to autonomously navigate unknown, complex, and dynamic real-world environments presents several challenges, including imperfect perception, partial observability, localization uncertainty, and safety constraints. Current approaches are typically limited to simulations, where such challenges are not present. In this work, we present a lightweight, open-architecture, end-to-end system for real-world robot autonomous navigation. Specifically, we deploy a real-time navigation system on a quadruped robot by integrating multiple onboard components that communicate via ROS2. Given navigation tasks specified in natural language, the system fuses onboard sensory data for localization and mapping with open-vocabulary semantics to build hierarchical scene graphs from a continuously updated semantic object map. An LLM-based planner leverages these graphs to generate and adapt multi-step plans in real time as the scene evolves. Through experiments across multiple indoor environments using a Unitree Go2 quadruped, we demonstrate zero-shot real-world autonomous navigation, achieving over 88% task success, and provide analysis of system behavior during deployment.
format Preprint
id arxiv_https___arxiv_org_abs_2410_06239
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Open-Architecture End-to-End System for Real-World Autonomous Robot Navigation
Devarakonda, Venkata Naren
Kaypak, Ali Umut
Goswami, Raktim Gautam
Patel, Naman
Khorrambakht, Rooholla
Krishnamurthy, Prashanth
Khorrami, Farshad
Robotics
Enabling robots to autonomously navigate unknown, complex, and dynamic real-world environments presents several challenges, including imperfect perception, partial observability, localization uncertainty, and safety constraints. Current approaches are typically limited to simulations, where such challenges are not present. In this work, we present a lightweight, open-architecture, end-to-end system for real-world robot autonomous navigation. Specifically, we deploy a real-time navigation system on a quadruped robot by integrating multiple onboard components that communicate via ROS2. Given navigation tasks specified in natural language, the system fuses onboard sensory data for localization and mapping with open-vocabulary semantics to build hierarchical scene graphs from a continuously updated semantic object map. An LLM-based planner leverages these graphs to generate and adapt multi-step plans in real time as the scene evolves. Through experiments across multiple indoor environments using a Unitree Go2 quadruped, we demonstrate zero-shot real-world autonomous navigation, achieving over 88% task success, and provide analysis of system behavior during deployment.
title Open-Architecture End-to-End System for Real-World Autonomous Robot Navigation
topic Robotics
url https://arxiv.org/abs/2410.06239