Robot Error Awareness Through Human Reactions: Implementation, Evaluation, and Recommendations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Stiber, Maia, Taylor, Russell, Huang, Chien-Ming
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910781808836608
author Stiber, Maia
Taylor, Russell
Huang, Chien-Ming
author_facet Stiber, Maia
Taylor, Russell
Huang, Chien-Ming
contents Effective error detection is crucial to prevent task disruption and maintain user trust. Traditional methods often rely on task-specific models or user reporting, which can be inflexible or slow. Recent research suggests social signals, naturally exhibited by users in response to robot errors, can enable more flexible, timely error detection. However, most studies rely on post hoc analysis, leaving their real-time effectiveness uncertain and lacking user-centric evaluation. In this work, we developed a proactive error detection system that combines user behavioral signals (facial action units and speech), user feedback, and error context for automatic error detection. In a study (N = 28), we compared our proactive system to a status quo reactive approach. Results show our system 1) reliably and flexibly detects error, 2) detects errors faster than the reactive approach, and 3) is perceived more favorably by users than the reactive one. We discuss recommendations for enabling robot error awareness in future HRI systems.
format Preprint
id arxiv_https___arxiv_org_abs_2501_05723
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robot Error Awareness Through Human Reactions: Implementation, Evaluation, and Recommendations
Stiber, Maia
Taylor, Russell
Huang, Chien-Ming
Robotics
Human-Computer Interaction
Effective error detection is crucial to prevent task disruption and maintain user trust. Traditional methods often rely on task-specific models or user reporting, which can be inflexible or slow. Recent research suggests social signals, naturally exhibited by users in response to robot errors, can enable more flexible, timely error detection. However, most studies rely on post hoc analysis, leaving their real-time effectiveness uncertain and lacking user-centric evaluation. In this work, we developed a proactive error detection system that combines user behavioral signals (facial action units and speech), user feedback, and error context for automatic error detection. In a study (N = 28), we compared our proactive system to a status quo reactive approach. Results show our system 1) reliably and flexibly detects error, 2) detects errors faster than the reactive approach, and 3) is perceived more favorably by users than the reactive one. We discuss recommendations for enabling robot error awareness in future HRI systems.
title Robot Error Awareness Through Human Reactions: Implementation, Evaluation, and Recommendations
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2501.05723