HDPlanner: Advancing Autonomous Deployments in Unknown Environments through Hierarchical Decision Networks

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liang, Jingsong, Cao, Yuhong, Ma, Yixiao, Zhao, Hanqi, Sartoretti, Guillaume
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929451639504896
author Liang, Jingsong
Cao, Yuhong
Ma, Yixiao
Zhao, Hanqi
Sartoretti, Guillaume
author_facet Liang, Jingsong
Cao, Yuhong
Ma, Yixiao
Zhao, Hanqi
Sartoretti, Guillaume
contents In this paper, we introduce HDPlanner, a deep reinforcement learning (DRL) based framework designed to tackle two core and challenging tasks for mobile robots: autonomous exploration and navigation, where the robot must optimize its trajectory adaptively to achieve the task objective through continuous interactions in unknown environments. Specifically, HDPlanner relies on novel hierarchical attention networks to empower the robot to reason about its belief across multiple spatial scales and sequence collaborative decisions, where our networks decompose long-term objectives into short-term informative task assignments and informative path plannings. We further propose a contrastive learning-based joint optimization to enhance the robustness of HDPlanner. We empirically demonstrate that HDPlanner significantly outperforms state-of-the-art conventional and learning-based baselines on an extensive set of simulations, including hundreds of test maps and large-scale, complex Gazebo environments. Notably, HDPlanner achieves real-time planning with travel distances reduced by up to 35.7% compared to exploration benchmarks and by up to 16.5% than navigation benchmarks. Furthermore, we validate our approach on hardware, where it generates high-quality, adaptive trajectories in both indoor and outdoor environments, highlighting its real-world applicability without additional training.
format Preprint
id arxiv_https___arxiv_org_abs_2408_03768
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle HDPlanner: Advancing Autonomous Deployments in Unknown Environments through Hierarchical Decision Networks
Liang, Jingsong
Cao, Yuhong
Ma, Yixiao
Zhao, Hanqi
Sartoretti, Guillaume
Robotics
In this paper, we introduce HDPlanner, a deep reinforcement learning (DRL) based framework designed to tackle two core and challenging tasks for mobile robots: autonomous exploration and navigation, where the robot must optimize its trajectory adaptively to achieve the task objective through continuous interactions in unknown environments. Specifically, HDPlanner relies on novel hierarchical attention networks to empower the robot to reason about its belief across multiple spatial scales and sequence collaborative decisions, where our networks decompose long-term objectives into short-term informative task assignments and informative path plannings. We further propose a contrastive learning-based joint optimization to enhance the robustness of HDPlanner. We empirically demonstrate that HDPlanner significantly outperforms state-of-the-art conventional and learning-based baselines on an extensive set of simulations, including hundreds of test maps and large-scale, complex Gazebo environments. Notably, HDPlanner achieves real-time planning with travel distances reduced by up to 35.7% compared to exploration benchmarks and by up to 16.5% than navigation benchmarks. Furthermore, we validate our approach on hardware, where it generates high-quality, adaptive trajectories in both indoor and outdoor environments, highlighting its real-world applicability without additional training.
title HDPlanner: Advancing Autonomous Deployments in Unknown Environments through Hierarchical Decision Networks
topic Robotics
url https://arxiv.org/abs/2408.03768