Inferring Operator Emotions from a Motion-Controlled Robotic Arm

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qi, Xinyu, Deng, Zeyu, Macdonald, Shaun Alexander, Li, Liying, Wang, Chen, Imran, Muhammad Ali, Zhao, Philip G.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911313681186816
author Qi, Xinyu
Deng, Zeyu
Macdonald, Shaun Alexander
Li, Liying
Wang, Chen
Imran, Muhammad Ali
Zhao, Philip G.
author_facet Qi, Xinyu
Deng, Zeyu
Macdonald, Shaun Alexander
Li, Liying
Wang, Chen
Imran, Muhammad Ali
Zhao, Philip G.
contents A remote robot operator's affective state can significantly impact the resulting robot's motions leading to unexpected consequences, even when the user follows protocol and performs permitted tasks. The recognition of a user operator's affective states in remote robot control scenarios is, however, underexplored. Current emotion recognition methods rely on reading the user's vital signs or body language, but the devices and user participation these measures require would add limitations to remote robot control. We demonstrate that the functional movements of a remote-controlled robotic avatar, which was not designed for emotional expression, can be used to infer the emotional state of the human operator via a machine-learning system. Specifically, our system achieved 83.3$\%$ accuracy in recognizing the user's emotional state expressed by robot movements, as a result of their hand motions. We discuss the implications of this system on prominent current and future remote robot operation and affective robotic contexts.
format Preprint
id arxiv_https___arxiv_org_abs_2512_09086
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Inferring Operator Emotions from a Motion-Controlled Robotic Arm
Qi, Xinyu
Deng, Zeyu
Macdonald, Shaun Alexander
Li, Liying
Wang, Chen
Imran, Muhammad Ali
Zhao, Philip G.
Robotics
Human-Computer Interaction
A remote robot operator's affective state can significantly impact the resulting robot's motions leading to unexpected consequences, even when the user follows protocol and performs permitted tasks. The recognition of a user operator's affective states in remote robot control scenarios is, however, underexplored. Current emotion recognition methods rely on reading the user's vital signs or body language, but the devices and user participation these measures require would add limitations to remote robot control. We demonstrate that the functional movements of a remote-controlled robotic avatar, which was not designed for emotional expression, can be used to infer the emotional state of the human operator via a machine-learning system. Specifically, our system achieved 83.3$\%$ accuracy in recognizing the user's emotional state expressed by robot movements, as a result of their hand motions. We discuss the implications of this system on prominent current and future remote robot operation and affective robotic contexts.
title Inferring Operator Emotions from a Motion-Controlled Robotic Arm
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2512.09086