IR2: Implicit Rendezvous for Robotic Exploration Teams under Sparse Intermittent Connectivity

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Tan, Derek Ming Siang, Ma, Yixiao, Liang, Jingsong, Chng, Yi Cheng, Cao, Yuhong, Sartoretti, Guillaume
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914104564776960
author Tan, Derek Ming Siang
Ma, Yixiao
Liang, Jingsong
Chng, Yi Cheng
Cao, Yuhong
Sartoretti, Guillaume
author_facet Tan, Derek Ming Siang
Ma, Yixiao
Liang, Jingsong
Chng, Yi Cheng
Cao, Yuhong
Sartoretti, Guillaume
contents Information sharing is critical in time-sensitive and realistic multi-robot exploration, especially for smaller robotic teams in large-scale environments where connectivity may be sparse and intermittent. Existing methods often overlook such communication constraints by assuming unrealistic global connectivity. Other works account for communication constraints (by maintaining close proximity or line of sight during information exchange), but are often inefficient. For instance, preplanned rendezvous approaches typically involve unnecessary detours resulting from poorly timed rendezvous, while pursuit-based approaches often result in short-sighted decisions due to their greedy nature. We present IR2, a deep reinforcement learning approach to information sharing for multi-robot exploration. Leveraging attention-based neural networks trained via reinforcement and curriculum learning, IR2 allows robots to effectively reason about the longer-term trade-offs between disconnecting for solo exploration and reconnecting for information sharing. In addition, we propose a hierarchical graph formulation to maintain a sparse yet informative graph, enabling our approach to scale to large-scale environments. We present simulation results in three large-scale Gazebo environments, which show that our approach yields 6.6-34.1% shorter exploration paths when compared to state-of-the-art baselines, and lastly deploy our learned policy on hardware. Our simulation training and testing code is available at https://ir2-explore.github.io.
format Preprint
id arxiv_https___arxiv_org_abs_2409_04730
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle IR2: Implicit Rendezvous for Robotic Exploration Teams under Sparse Intermittent Connectivity
Tan, Derek Ming Siang
Ma, Yixiao
Liang, Jingsong
Chng, Yi Cheng
Cao, Yuhong
Sartoretti, Guillaume
Robotics
Information sharing is critical in time-sensitive and realistic multi-robot exploration, especially for smaller robotic teams in large-scale environments where connectivity may be sparse and intermittent. Existing methods often overlook such communication constraints by assuming unrealistic global connectivity. Other works account for communication constraints (by maintaining close proximity or line of sight during information exchange), but are often inefficient. For instance, preplanned rendezvous approaches typically involve unnecessary detours resulting from poorly timed rendezvous, while pursuit-based approaches often result in short-sighted decisions due to their greedy nature. We present IR2, a deep reinforcement learning approach to information sharing for multi-robot exploration. Leveraging attention-based neural networks trained via reinforcement and curriculum learning, IR2 allows robots to effectively reason about the longer-term trade-offs between disconnecting for solo exploration and reconnecting for information sharing. In addition, we propose a hierarchical graph formulation to maintain a sparse yet informative graph, enabling our approach to scale to large-scale environments. We present simulation results in three large-scale Gazebo environments, which show that our approach yields 6.6-34.1% shorter exploration paths when compared to state-of-the-art baselines, and lastly deploy our learned policy on hardware. Our simulation training and testing code is available at https://ir2-explore.github.io.
title IR2: Implicit Rendezvous for Robotic Exploration Teams under Sparse Intermittent Connectivity
topic Robotics
url https://arxiv.org/abs/2409.04730