Uncertainty Estimation in the Real World: A Study on Music Emotion Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Watcharasupat, Karn N., Ding, Yiwei, Ma, T. Aleksandra, Seshadri, Pavan, Lerch, Alexander
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916574482399232
author Watcharasupat, Karn N.
Ding, Yiwei
Ma, T. Aleksandra
Seshadri, Pavan
Lerch, Alexander
author_facet Watcharasupat, Karn N.
Ding, Yiwei
Ma, T. Aleksandra
Seshadri, Pavan
Lerch, Alexander
contents Any data annotation for subjective tasks shows potential variations between individuals. This is particularly true for annotations of emotional responses to musical stimuli. While older approaches to music emotion recognition systems frequently addressed this uncertainty problem through probabilistic modeling, modern systems based on neural networks tend to ignore the variability and focus only on predicting central tendencies of human subjective responses. In this work, we explore several methods for estimating not only the central tendencies of the subjective responses to a musical stimulus, but also for estimating the uncertainty associated with these responses. In particular, we investigate probabilistic loss functions and inference-time random sampling. Experimental results indicate that while the modeling of the central tendencies is achievable, modeling of the uncertainty in subjective responses proves significantly more challenging with currently available approaches even when empirical estimates of variations in the responses are available.
format Preprint
id arxiv_https___arxiv_org_abs_2501_11570
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Uncertainty Estimation in the Real World: A Study on Music Emotion Recognition
Watcharasupat, Karn N.
Ding, Yiwei
Ma, T. Aleksandra
Seshadri, Pavan
Lerch, Alexander
Sound
Information Retrieval
Machine Learning
Audio and Speech Processing
Any data annotation for subjective tasks shows potential variations between individuals. This is particularly true for annotations of emotional responses to musical stimuli. While older approaches to music emotion recognition systems frequently addressed this uncertainty problem through probabilistic modeling, modern systems based on neural networks tend to ignore the variability and focus only on predicting central tendencies of human subjective responses. In this work, we explore several methods for estimating not only the central tendencies of the subjective responses to a musical stimulus, but also for estimating the uncertainty associated with these responses. In particular, we investigate probabilistic loss functions and inference-time random sampling. Experimental results indicate that while the modeling of the central tendencies is achievable, modeling of the uncertainty in subjective responses proves significantly more challenging with currently available approaches even when empirical estimates of variations in the responses are available.
title Uncertainty Estimation in the Real World: A Study on Music Emotion Recognition
topic Sound
Information Retrieval
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2501.11570