The Power of Properties: Uncovering the Influential Factors in Emotion Classification

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Büchner, Tim, Penzel, Niklas, Guntinas-Lichius, Orlando, Denzler, Joachim
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917637460590592
author Büchner, Tim
Penzel, Niklas
Guntinas-Lichius, Orlando
Denzler, Joachim
author_facet Büchner, Tim
Penzel, Niklas
Guntinas-Lichius, Orlando
Denzler, Joachim
contents Facial expression-based human emotion recognition is a critical research area in psychology and medicine. State-of-the-art classification performance is only reached by end-to-end trained neural networks. Nevertheless, such black-box models lack transparency in their decision-making processes, prompting efforts to ascertain the rules that underlie classifiers' decisions. Analyzing single inputs alone fails to expose systematic learned biases. These biases can be characterized as facial properties summarizing abstract information like age or medical conditions. Therefore, understanding a model's prediction behavior requires an analysis rooted in causality along such selected properties. We demonstrate that up to 91.25% of classifier output behavior changes are statistically significant concerning basic properties. Among those are age, gender, and facial symmetry. Furthermore, the medical usage of surface electromyography significantly influences emotion prediction. We introduce a workflow to evaluate explicit properties and their impact. These insights might help medical professionals select and apply classifiers regarding their specialized data and properties.
format Preprint
id arxiv_https___arxiv_org_abs_2404_07867
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Power of Properties: Uncovering the Influential Factors in Emotion Classification
Büchner, Tim
Penzel, Niklas
Guntinas-Lichius, Orlando
Denzler, Joachim
Computer Vision and Pattern Recognition
Facial expression-based human emotion recognition is a critical research area in psychology and medicine. State-of-the-art classification performance is only reached by end-to-end trained neural networks. Nevertheless, such black-box models lack transparency in their decision-making processes, prompting efforts to ascertain the rules that underlie classifiers' decisions. Analyzing single inputs alone fails to expose systematic learned biases. These biases can be characterized as facial properties summarizing abstract information like age or medical conditions. Therefore, understanding a model's prediction behavior requires an analysis rooted in causality along such selected properties. We demonstrate that up to 91.25% of classifier output behavior changes are statistically significant concerning basic properties. Among those are age, gender, and facial symmetry. Furthermore, the medical usage of surface electromyography significantly influences emotion prediction. We introduce a workflow to evaluate explicit properties and their impact. These insights might help medical professionals select and apply classifiers regarding their specialized data and properties.
title The Power of Properties: Uncovering the Influential Factors in Emotion Classification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2404.07867