Why Report Failed Interactions With Robots?! Towards Vignette-based Interaction Quality

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Axelsson, Agnes, Reimann, Merle, Cumbal, Ronald, Pelikan, Hannah, Lala, Divesh
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918137196183552
author Axelsson, Agnes
Reimann, Merle
Cumbal, Ronald
Pelikan, Hannah
Lala, Divesh
author_facet Axelsson, Agnes
Reimann, Merle
Cumbal, Ronald
Pelikan, Hannah
Lala, Divesh
contents Although the quality of human-robot interactions has improved with the advent of LLMs, there are still various factors that cause systems to be sub-optimal when compared to human-human interactions. The nature and criticality of failures are often dependent on the context of the interaction and so cannot be generalized across the wide range of scenarios and experiments which have been implemented in HRI research. In this work we propose the use of a technique overlooked in the field of HRI, ethnographic vignettes, to clearly highlight these failures, particularly those that are rarely documented. We describe the methodology behind the process of writing vignettes and create our own based on our personal experiences with failures in HRI systems. We emphasize the strength of vignettes as the ability to communicate failures from a multi-disciplinary perspective, promote transparency about the capabilities of robots, and document unexpected behaviours which would otherwise be omitted from research reports. We encourage the use of vignettes to augment existing interaction evaluation methods.
format Preprint
id arxiv_https___arxiv_org_abs_2508_10603
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Why Report Failed Interactions With Robots?! Towards Vignette-based Interaction Quality
Axelsson, Agnes
Reimann, Merle
Cumbal, Ronald
Pelikan, Hannah
Lala, Divesh
Robotics
Human-Computer Interaction
Although the quality of human-robot interactions has improved with the advent of LLMs, there are still various factors that cause systems to be sub-optimal when compared to human-human interactions. The nature and criticality of failures are often dependent on the context of the interaction and so cannot be generalized across the wide range of scenarios and experiments which have been implemented in HRI research. In this work we propose the use of a technique overlooked in the field of HRI, ethnographic vignettes, to clearly highlight these failures, particularly those that are rarely documented. We describe the methodology behind the process of writing vignettes and create our own based on our personal experiences with failures in HRI systems. We emphasize the strength of vignettes as the ability to communicate failures from a multi-disciplinary perspective, promote transparency about the capabilities of robots, and document unexpected behaviours which would otherwise be omitted from research reports. We encourage the use of vignettes to augment existing interaction evaluation methods.
title Why Report Failed Interactions With Robots?! Towards Vignette-based Interaction Quality
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2508.10603