Investigating the Impact of Word Informativeness on Speech Emotion Recognition

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Kakouros, Sofoklis
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910982528303104
author Kakouros, Sofoklis
author_facet Kakouros, Sofoklis
contents In emotion recognition from speech, a key challenge lies in identifying speech signal segments that carry the most relevant acoustic variations for discerning specific emotions. Traditional approaches compute functionals for features such as energy and F0 over entire sentences or longer speech portions, potentially missing essential fine-grained variation in the long-form statistics. This research investigates the use of word informativeness, derived from a pre-trained language model, to identify semantically important segments. Acoustic features are then computed exclusively for these identified segments, enhancing emotion recognition accuracy. The methodology utilizes standard acoustic prosodic features, their functionals, and self-supervised representations. Results indicate a notable improvement in recognition performance when features are computed on segments selected based on word informativeness, underscoring the effectiveness of this approach.
format Preprint
id arxiv_https___arxiv_org_abs_2506_02239
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Investigating the Impact of Word Informativeness on Speech Emotion Recognition
Kakouros, Sofoklis
Computation and Language
Audio and Speech Processing
In emotion recognition from speech, a key challenge lies in identifying speech signal segments that carry the most relevant acoustic variations for discerning specific emotions. Traditional approaches compute functionals for features such as energy and F0 over entire sentences or longer speech portions, potentially missing essential fine-grained variation in the long-form statistics. This research investigates the use of word informativeness, derived from a pre-trained language model, to identify semantically important segments. Acoustic features are then computed exclusively for these identified segments, enhancing emotion recognition accuracy. The methodology utilizes standard acoustic prosodic features, their functionals, and self-supervised representations. Results indicate a notable improvement in recognition performance when features are computed on segments selected based on word informativeness, underscoring the effectiveness of this approach.
title Investigating the Impact of Word Informativeness on Speech Emotion Recognition
topic Computation and Language
Audio and Speech Processing
url https://arxiv.org/abs/2506.02239