Semi-Supervised Self-Learning Enhanced Music Emotion Recognition

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Sun, Yifu, Zhang, Xulong, Zhou, Monan, Li, Wei
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912339690782720
author Sun, Yifu
Zhang, Xulong
Zhou, Monan
Li, Wei
author_facet Sun, Yifu
Zhang, Xulong
Zhou, Monan
Li, Wei
contents Music emotion recognition (MER) aims to identify the emotions conveyed in a given musical piece. However, currently, in the field of MER, the available public datasets have limited sample sizes. Recently, segment-based methods for emotion-related tasks have been proposed, which train backbone networks on shorter segments instead of entire audio clips, thereby naturally augmenting training samples without requiring additional resources. Then, the predicted segment-level results are aggregated to obtain the entire song prediction. The most commonly used method is that the segment inherits the label of the clip containing it, but music emotion is not constant during the whole clip. Doing so will introduce label noise and make the training easy to overfit. To handle the noisy label issue, we propose a semi-supervised self-learning (SSSL) method, which can differentiate between samples with correct and incorrect labels in a self-learning manner, thus effectively utilizing the augmented segment-level data. Experiments on three public emotional datasets demonstrate that the proposed method can achieve better or comparable performance.
format Preprint
id arxiv_https___arxiv_org_abs_2410_21897
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Semi-Supervised Self-Learning Enhanced Music Emotion Recognition
Sun, Yifu
Zhang, Xulong
Zhou, Monan
Li, Wei
Sound
Artificial Intelligence
Audio and Speech Processing
Music emotion recognition (MER) aims to identify the emotions conveyed in a given musical piece. However, currently, in the field of MER, the available public datasets have limited sample sizes. Recently, segment-based methods for emotion-related tasks have been proposed, which train backbone networks on shorter segments instead of entire audio clips, thereby naturally augmenting training samples without requiring additional resources. Then, the predicted segment-level results are aggregated to obtain the entire song prediction. The most commonly used method is that the segment inherits the label of the clip containing it, but music emotion is not constant during the whole clip. Doing so will introduce label noise and make the training easy to overfit. To handle the noisy label issue, we propose a semi-supervised self-learning (SSSL) method, which can differentiate between samples with correct and incorrect labels in a self-learning manner, thus effectively utilizing the augmented segment-level data. Experiments on three public emotional datasets demonstrate that the proposed method can achieve better or comparable performance.
title Semi-Supervised Self-Learning Enhanced Music Emotion Recognition
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2410.21897