On the Contribution of Lexical Features to Speech Emotion Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Combei, David
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912574366285824
author Combei, David
author_facet Combei, David
contents Although paralinguistic cues are often considered the primary drivers of speech emotion recognition (SER), we investigate the role of lexical content extracted from speech and show that it can achieve competitive and in some cases higher performance compared to acoustic models. On the MELD dataset, our lexical-based approach obtains a weighted F1-score (WF1) of 51.5%, compared to 49.3% for an acoustic-only pipeline with a larger parameter count. Furthermore, we analyze different self-supervised (SSL) speech and text representations, conduct a layer-wise study of transformer-based encoders, and evaluate the effect of audio denoising.
format Preprint
id arxiv_https___arxiv_org_abs_2509_05634
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On the Contribution of Lexical Features to Speech Emotion Recognition
Combei, David
Audio and Speech Processing
Computation and Language
Sound
Although paralinguistic cues are often considered the primary drivers of speech emotion recognition (SER), we investigate the role of lexical content extracted from speech and show that it can achieve competitive and in some cases higher performance compared to acoustic models. On the MELD dataset, our lexical-based approach obtains a weighted F1-score (WF1) of 51.5%, compared to 49.3% for an acoustic-only pipeline with a larger parameter count. Furthermore, we analyze different self-supervised (SSL) speech and text representations, conduct a layer-wise study of transformer-based encoders, and evaluate the effect of audio denoising.
title On the Contribution of Lexical Features to Speech Emotion Recognition
topic Audio and Speech Processing
Computation and Language
Sound
url https://arxiv.org/abs/2509.05634