Are you sure? Analysing Uncertainty Quantification Approaches for Real-world Speech Emotion Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schrüfer, Oliver, Milling, Manuel, Burkhardt, Felix, Eyben, Florian, Schuller, Björn
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913411607035904
author Schrüfer, Oliver
Milling, Manuel
Burkhardt, Felix
Eyben, Florian
Schuller, Björn
author_facet Schrüfer, Oliver
Milling, Manuel
Burkhardt, Felix
Eyben, Florian
Schuller, Björn
contents Uncertainty Quantification (UQ) is an important building block for the reliable use of neural networks in real-world scenarios, as it can be a useful tool in identifying faulty predictions. Speech emotion recognition (SER) models can suffer from particularly many sources of uncertainty, such as the ambiguity of emotions, Out-of-Distribution (OOD) data or, in general, poor recording conditions. Reliable UQ methods are thus of particular interest as in many SER applications no prediction is better than a faulty prediction. While the effects of label ambiguity on uncertainty are well documented in the literature, we focus our work on an evaluation of UQ methods for SER under common challenges in real-world application, such as corrupted signals, and the absence of speech. We show that simple UQ methods can already give an indication of the uncertainty of a prediction and that training with additional OOD data can greatly improve the identification of such signals.
format Preprint
id arxiv_https___arxiv_org_abs_2407_01143
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Are you sure? Analysing Uncertainty Quantification Approaches for Real-world Speech Emotion Recognition
Schrüfer, Oliver
Milling, Manuel
Burkhardt, Felix
Eyben, Florian
Schuller, Björn
Sound
Artificial Intelligence
Audio and Speech Processing
Uncertainty Quantification (UQ) is an important building block for the reliable use of neural networks in real-world scenarios, as it can be a useful tool in identifying faulty predictions. Speech emotion recognition (SER) models can suffer from particularly many sources of uncertainty, such as the ambiguity of emotions, Out-of-Distribution (OOD) data or, in general, poor recording conditions. Reliable UQ methods are thus of particular interest as in many SER applications no prediction is better than a faulty prediction. While the effects of label ambiguity on uncertainty are well documented in the literature, we focus our work on an evaluation of UQ methods for SER under common challenges in real-world application, such as corrupted signals, and the absence of speech. We show that simple UQ methods can already give an indication of the uncertainty of a prediction and that training with additional OOD data can greatly improve the identification of such signals.
title Are you sure? Analysing Uncertainty Quantification Approaches for Real-world Speech Emotion Recognition
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2407.01143