BSC-UPC at EmoSPeech-IberLEF2024: Attention Pooling for Emotion Recognition

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Casals-Salvador, Marc, Costa, Federico, India, Miquel, Hernando, Javier
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917724932800512
author Casals-Salvador, Marc
Costa, Federico
India, Miquel
Hernando, Javier
author_facet Casals-Salvador, Marc
Costa, Federico
India, Miquel
Hernando, Javier
contents The domain of speech emotion recognition (SER) has persistently been a frontier within the landscape of machine learning. It is an active field that has been revolutionized in the last few decades and whose implementations are remarkable in multiple applications that could affect daily life. Consequently, the Iberian Languages Evaluation Forum (IberLEF) of 2024 held a competitive challenge to leverage the SER results with a Spanish corpus. This paper presents the approach followed with the goal of participating in this competition. The main architecture consists of different pre-trained speech and text models to extract features from both modalities, utilizing an attention pooling mechanism. The proposed system has achieved the first position in the challenge with an 86.69% in Macro F1-Score.
format Preprint
id arxiv_https___arxiv_org_abs_2407_12467
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle BSC-UPC at EmoSPeech-IberLEF2024: Attention Pooling for Emotion Recognition
Casals-Salvador, Marc
Costa, Federico
India, Miquel
Hernando, Javier
Audio and Speech Processing
The domain of speech emotion recognition (SER) has persistently been a frontier within the landscape of machine learning. It is an active field that has been revolutionized in the last few decades and whose implementations are remarkable in multiple applications that could affect daily life. Consequently, the Iberian Languages Evaluation Forum (IberLEF) of 2024 held a competitive challenge to leverage the SER results with a Spanish corpus. This paper presents the approach followed with the goal of participating in this competition. The main architecture consists of different pre-trained speech and text models to extract features from both modalities, utilizing an attention pooling mechanism. The proposed system has achieved the first position in the challenge with an 86.69% in Macro F1-Score.
title BSC-UPC at EmoSPeech-IberLEF2024: Attention Pooling for Emotion Recognition
topic Audio and Speech Processing
url https://arxiv.org/abs/2407.12467