Hearing the Robot's Mind: Sonification for Explicit Feedback in Human-Robot Interaction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Arreghini, Simone, Paolillo, Antonio, Abbate, Gabriele, Giusti, Alessandro
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916479997313024
author Arreghini, Simone
Paolillo, Antonio
Abbate, Gabriele
Giusti, Alessandro
author_facet Arreghini, Simone
Paolillo, Antonio
Abbate, Gabriele
Giusti, Alessandro
contents Social robots are required not only to understand human intentions but also to effectively communicate their intentions or own internal states to users. This study explores the use of sonification to provide explicit auditory feedback, enhancing mutual understanding in HRI. We introduce a novel sonification approach that conveys the robot's internal state, linked to its perception of nearby individuals and their interaction intentions. The approach is evaluated through a two-fold user study: an online video-based survey with $26$ participants and live experiments with $10$ participants. Results indicate that while sonification improves the robot's expressivity and communication effectiveness, the design of the auditory feedback needs refinement to enhance user experience. Participants found the auditory cues useful but described the sounds as uninteresting and unpleasant. These findings underscore the importance of carefully designed auditory feedback in developing more effective and engaging HRI systems.
format Preprint
id arxiv_https___arxiv_org_abs_2411_09299
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Hearing the Robot's Mind: Sonification for Explicit Feedback in Human-Robot Interaction
Arreghini, Simone
Paolillo, Antonio
Abbate, Gabriele
Giusti, Alessandro
Robotics
Social robots are required not only to understand human intentions but also to effectively communicate their intentions or own internal states to users. This study explores the use of sonification to provide explicit auditory feedback, enhancing mutual understanding in HRI. We introduce a novel sonification approach that conveys the robot's internal state, linked to its perception of nearby individuals and their interaction intentions. The approach is evaluated through a two-fold user study: an online video-based survey with $26$ participants and live experiments with $10$ participants. Results indicate that while sonification improves the robot's expressivity and communication effectiveness, the design of the auditory feedback needs refinement to enhance user experience. Participants found the auditory cues useful but described the sounds as uninteresting and unpleasant. These findings underscore the importance of carefully designed auditory feedback in developing more effective and engaging HRI systems.
title Hearing the Robot's Mind: Sonification for Explicit Feedback in Human-Robot Interaction
topic Robotics
url https://arxiv.org/abs/2411.09299