Augmented Reality User Interface for Command, Control, and Supervision of Large Multi-Agent Teams

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Regal, Frank, Suarez, Chris, Parra, Fabian, Pryor, Mitch
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913191874789376
author Regal, Frank
Suarez, Chris
Parra, Fabian
Pryor, Mitch
author_facet Regal, Frank
Suarez, Chris
Parra, Fabian
Pryor, Mitch
contents Multi-agent human-robot teaming allows for the potential to gather information about various environments more efficiently by exploiting and combining the strengths of humans and robots. In industries like defense, search and rescue, first-response, and others alike, heterogeneous human-robot teams show promise to accelerate data collection and improve team safety by removing humans from unknown and potentially hazardous situations. This work builds upon AugRE, an Augmented Reality (AR) based scalable human-robot teaming framework. It enables users to localize and communicate with 50+ autonomous agents. Through our efforts, users are able to command, control, and supervise agents in large teams, both line-of-sight and non-line-of-sight, without the need to modify the environment prior and without requiring users to use typical hardware (i.e. joysticks, keyboards, laptops, tablets, etc.) in the field. The demonstrated work shows early indications that combining these AR-HMD-based user interaction modalities for command, control, and supervision will help improve human-robot team collaboration, robustness, and trust.
format Preprint
id arxiv_https___arxiv_org_abs_2401_05665
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Augmented Reality User Interface for Command, Control, and Supervision of Large Multi-Agent Teams
Regal, Frank
Suarez, Chris
Parra, Fabian
Pryor, Mitch
Robotics
Human-Computer Interaction
Multi-agent human-robot teaming allows for the potential to gather information about various environments more efficiently by exploiting and combining the strengths of humans and robots. In industries like defense, search and rescue, first-response, and others alike, heterogeneous human-robot teams show promise to accelerate data collection and improve team safety by removing humans from unknown and potentially hazardous situations. This work builds upon AugRE, an Augmented Reality (AR) based scalable human-robot teaming framework. It enables users to localize and communicate with 50+ autonomous agents. Through our efforts, users are able to command, control, and supervise agents in large teams, both line-of-sight and non-line-of-sight, without the need to modify the environment prior and without requiring users to use typical hardware (i.e. joysticks, keyboards, laptops, tablets, etc.) in the field. The demonstrated work shows early indications that combining these AR-HMD-based user interaction modalities for command, control, and supervision will help improve human-robot team collaboration, robustness, and trust.
title Augmented Reality User Interface for Command, Control, and Supervision of Large Multi-Agent Teams
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2401.05665