"I think you need help! Here's why": Understanding the Effect of Explanations on Automatic Facial Expression Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nahulanthran, Sanjeev, Vered, Mor, Tian, Leimin, Kulić, Dana
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909347478503424
author Nahulanthran, Sanjeev
Vered, Mor
Tian, Leimin
Kulić, Dana
author_facet Nahulanthran, Sanjeev
Vered, Mor
Tian, Leimin
Kulić, Dana
contents Facial expression recognition (FER) has emerged as a promising approach to the development of emotion-aware intelligent systems. The performance of FER in multiple domains is continuously being improved, especially through advancements in data-driven learning approaches. However, a key challenge remains in utilizing FER in real-world contexts, namely ensuring user understanding of these systems and establishing a suitable level of user trust towards this technology. We conducted an empirical user study to investigate how explanations of FER can improve trust, understanding and performance in a human-computer interaction task that uses FER to trigger helpful hints during a navigation game. Our results showed that users provided with explanations of the FER system demonstrated improved control in using the system to their advantage, leading to a significant improvement in their understanding of the system, reduced collisions in the navigation game, as well as increased trust towards the system.
format Preprint
id arxiv_https___arxiv_org_abs_2410_09743
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle "I think you need help! Here's why": Understanding the Effect of Explanations on Automatic Facial Expression Recognition
Nahulanthran, Sanjeev
Vered, Mor
Tian, Leimin
Kulić, Dana
Human-Computer Interaction
Facial expression recognition (FER) has emerged as a promising approach to the development of emotion-aware intelligent systems. The performance of FER in multiple domains is continuously being improved, especially through advancements in data-driven learning approaches. However, a key challenge remains in utilizing FER in real-world contexts, namely ensuring user understanding of these systems and establishing a suitable level of user trust towards this technology. We conducted an empirical user study to investigate how explanations of FER can improve trust, understanding and performance in a human-computer interaction task that uses FER to trigger helpful hints during a navigation game. Our results showed that users provided with explanations of the FER system demonstrated improved control in using the system to their advantage, leading to a significant improvement in their understanding of the system, reduced collisions in the navigation game, as well as increased trust towards the system.
title "I think you need help! Here's why": Understanding the Effect of Explanations on Automatic Facial Expression Recognition
topic Human-Computer Interaction
url https://arxiv.org/abs/2410.09743