HORUS: A Mixed Reality Interface for Managing Teams of Mobile Robots

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Adekoya, Omotoye Shamsudeen, Sgorbissa, Antonio, Recchiuto, Carmine Tommaso
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909634907865088
author Adekoya, Omotoye Shamsudeen
Sgorbissa, Antonio
Recchiuto, Carmine Tommaso
author_facet Adekoya, Omotoye Shamsudeen
Sgorbissa, Antonio
Recchiuto, Carmine Tommaso
contents Mixed Reality (MR) interfaces have been extensively explored for controlling mobile robots, but there is limited research on their application to managing teams of robots. This paper presents HORUS: Holistic Operational Reality for Unified Systems, a Mixed Reality interface offering a comprehensive set of tools for managing multiple mobile robots simultaneously. HORUS enables operators to monitor individual robot statuses, visualize sensor data projected in real time, and assign tasks to single robots, subsets of the team, or the entire group, all from a Mini-Map (Ground Station). The interface also provides different teleoperation modes: a mini-map mode that allows teleoperation while observing the robot model and its transform on the mini-map, and a semi-immersive mode that offers a flat, screen-like view in either single or stereo view (3D). We conducted a user study in which participants used HORUS to manage a team of mobile robots tasked with finding clues in an environment, simulating search and rescue tasks. This study compared HORUS's full-team management capabilities with individual robot teleoperation. The experiments validated the versatility and effectiveness of HORUS in multi-robot coordination, demonstrating its potential to advance human-robot collaboration in dynamic, team-based environments.
format Preprint
id arxiv_https___arxiv_org_abs_2506_02622
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HORUS: A Mixed Reality Interface for Managing Teams of Mobile Robots
Adekoya, Omotoye Shamsudeen
Sgorbissa, Antonio
Recchiuto, Carmine Tommaso
Robotics
Human-Computer Interaction
Mixed Reality (MR) interfaces have been extensively explored for controlling mobile robots, but there is limited research on their application to managing teams of robots. This paper presents HORUS: Holistic Operational Reality for Unified Systems, a Mixed Reality interface offering a comprehensive set of tools for managing multiple mobile robots simultaneously. HORUS enables operators to monitor individual robot statuses, visualize sensor data projected in real time, and assign tasks to single robots, subsets of the team, or the entire group, all from a Mini-Map (Ground Station). The interface also provides different teleoperation modes: a mini-map mode that allows teleoperation while observing the robot model and its transform on the mini-map, and a semi-immersive mode that offers a flat, screen-like view in either single or stereo view (3D). We conducted a user study in which participants used HORUS to manage a team of mobile robots tasked with finding clues in an environment, simulating search and rescue tasks. This study compared HORUS's full-team management capabilities with individual robot teleoperation. The experiments validated the versatility and effectiveness of HORUS in multi-robot coordination, demonstrating its potential to advance human-robot collaboration in dynamic, team-based environments.
title HORUS: A Mixed Reality Interface for Managing Teams of Mobile Robots
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2506.02622