Cognitive Load-based Affective Workload Allocation for Multi-human Multi-robot Teams

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Jo, Wonse, Wang, Ruiqi, Yang, Baijian, Foti, Dan, Rastgaar, Mo, Min, Byung-Cheol
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913567397117952
author Jo, Wonse
Wang, Ruiqi
Yang, Baijian
Foti, Dan
Rastgaar, Mo
Min, Byung-Cheol
author_facet Jo, Wonse
Wang, Ruiqi
Yang, Baijian
Foti, Dan
Rastgaar, Mo
Min, Byung-Cheol
contents The interaction and collaboration between humans and multiple robots represent a novel field of research known as human multi-robot systems. Adequately designed systems within this field allow teams composed of both humans and robots to work together effectively on tasks such as monitoring, exploration, and search and rescue operations. This paper presents a deep reinforcement learning-based affective workload allocation controller specifically for multi-human multi-robot teams. The proposed controller can dynamically reallocate workloads based on the performance of the operators during collaborative missions with multi-robot systems. The operators' performances are evaluated through the scores of a self-reported questionnaire (i.e., subjective measurement) and the results of a deep learning-based cognitive workload prediction algorithm that uses physiological and behavioral data (i.e., objective measurement). To evaluate the effectiveness of the proposed controller, we use a multi-human multi-robot CCTV monitoring task as an example and carry out comprehensive real-world experiments with 32 human subjects for both quantitative measurement and qualitative analysis. Our results demonstrate the performance and effectiveness of the proposed controller and highlight the importance of incorporating both subjective and objective measurements of the operators' cognitive workload as well as seeking consent for workload transitions, to enhance the performance of multi-human multi-robot teams.
format Preprint
id arxiv_https___arxiv_org_abs_2303_10465
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Cognitive Load-based Affective Workload Allocation for Multi-human Multi-robot Teams
Jo, Wonse
Wang, Ruiqi
Yang, Baijian
Foti, Dan
Rastgaar, Mo
Min, Byung-Cheol
Human-Computer Interaction
Robotics
The interaction and collaboration between humans and multiple robots represent a novel field of research known as human multi-robot systems. Adequately designed systems within this field allow teams composed of both humans and robots to work together effectively on tasks such as monitoring, exploration, and search and rescue operations. This paper presents a deep reinforcement learning-based affective workload allocation controller specifically for multi-human multi-robot teams. The proposed controller can dynamically reallocate workloads based on the performance of the operators during collaborative missions with multi-robot systems. The operators' performances are evaluated through the scores of a self-reported questionnaire (i.e., subjective measurement) and the results of a deep learning-based cognitive workload prediction algorithm that uses physiological and behavioral data (i.e., objective measurement). To evaluate the effectiveness of the proposed controller, we use a multi-human multi-robot CCTV monitoring task as an example and carry out comprehensive real-world experiments with 32 human subjects for both quantitative measurement and qualitative analysis. Our results demonstrate the performance and effectiveness of the proposed controller and highlight the importance of incorporating both subjective and objective measurements of the operators' cognitive workload as well as seeking consent for workload transitions, to enhance the performance of multi-human multi-robot teams.
title Cognitive Load-based Affective Workload Allocation for Multi-human Multi-robot Teams
topic Human-Computer Interaction
Robotics
url https://arxiv.org/abs/2303.10465