Saved in:
Bibliographic Details
Main Authors: Ruan, Tianshu, Ramesh, Aniketh, Stolkin, Rustam, Chiou, Manolis
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.17376
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915474191679488
author Ruan, Tianshu
Ramesh, Aniketh
Stolkin, Rustam
Chiou, Manolis
author_facet Ruan, Tianshu
Ramesh, Aniketh
Stolkin, Rustam
Chiou, Manolis
contents In this paper, we investigate the impact of high-level semantics (evaluation of the environment) on Human-Robot Teams (HRT) and Human-Robot Interaction (HRI) in the context of mobile robot deployments. Although semantics has been widely researched in AI, how high-level semantics can benefit the HRT paradigm is underexplored, often fuzzy, and intractable. We applied a semantics-based framework that could reveal different indicators of the environment (i.e. how much semantic information exists) in a mock-up disaster response mission. In such missions, semantics are crucial as the HRT should handle complex situations and respond quickly with correct decisions, where humans might have a high workload and stress. Especially when human operators need to shift their attention between robots and other tasks, they will struggle to build Situational Awareness (SA) quickly. The experiment suggests that the presented semantics: 1) alleviate the perceived workload of human operators; 2) increase the operator's trust in the SA; and 3) help to reduce the reaction time in switching the level of autonomy when needed. Additionally, we find that participants with higher trust in the system are encouraged by high-level semantics to use teleoperation mode more.
format Preprint
id arxiv_https___arxiv_org_abs_2507_17376
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An Exploratory Study on Human-Robot Interaction using Semantics-based Situational Awareness
Ruan, Tianshu
Ramesh, Aniketh
Stolkin, Rustam
Chiou, Manolis
Robotics
In this paper, we investigate the impact of high-level semantics (evaluation of the environment) on Human-Robot Teams (HRT) and Human-Robot Interaction (HRI) in the context of mobile robot deployments. Although semantics has been widely researched in AI, how high-level semantics can benefit the HRT paradigm is underexplored, often fuzzy, and intractable. We applied a semantics-based framework that could reveal different indicators of the environment (i.e. how much semantic information exists) in a mock-up disaster response mission. In such missions, semantics are crucial as the HRT should handle complex situations and respond quickly with correct decisions, where humans might have a high workload and stress. Especially when human operators need to shift their attention between robots and other tasks, they will struggle to build Situational Awareness (SA) quickly. The experiment suggests that the presented semantics: 1) alleviate the perceived workload of human operators; 2) increase the operator's trust in the SA; and 3) help to reduce the reaction time in switching the level of autonomy when needed. Additionally, we find that participants with higher trust in the system are encouraged by high-level semantics to use teleoperation mode more.
title An Exploratory Study on Human-Robot Interaction using Semantics-based Situational Awareness
topic Robotics
url https://arxiv.org/abs/2507.17376