learning discriminative features from spectrograms using center loss for speech emotion recognition

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Dai, Dongyang, Wu, Zhiyong, Li, Runnan, Wu, Xixin, Jia, Jia, Meng, Helen
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917882775994368
author Dai, Dongyang
Wu, Zhiyong
Li, Runnan
Wu, Xixin
Jia, Jia
Meng, Helen
author_facet Dai, Dongyang
Wu, Zhiyong
Li, Runnan
Wu, Xixin
Jia, Jia
Meng, Helen
contents Identifying the emotional state from speech is essential for the natural interaction of the machine with the speaker. However, extracting effective features for emotion recognition is difficult, as emotions are ambiguous. We propose a novel approach to learn discriminative features from variable length spectrograms for emotion recognition by cooperating softmax cross-entropy loss and center loss together. The softmax cross-entropy loss enables features from different emotion categories separable, and center loss efficiently pulls the features belonging to the same emotion category to their center. By combining the two losses together, the discriminative power will be highly enhanced, which leads to network learning more effective features for emotion recognition. As demonstrated by the experimental results, after introducing center loss, both the unweighted accuracy and weighted accuracy are improved by over 3\% on Mel-spectrogram input, and more than 4\% on Short Time Fourier Transform spectrogram input.
format Preprint
id arxiv_https___arxiv_org_abs_2501_01103
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle learning discriminative features from spectrograms using center loss for speech emotion recognition
Dai, Dongyang
Wu, Zhiyong
Li, Runnan
Wu, Xixin
Jia, Jia
Meng, Helen
Audio and Speech Processing
Artificial Intelligence
Sound
Identifying the emotional state from speech is essential for the natural interaction of the machine with the speaker. However, extracting effective features for emotion recognition is difficult, as emotions are ambiguous. We propose a novel approach to learn discriminative features from variable length spectrograms for emotion recognition by cooperating softmax cross-entropy loss and center loss together. The softmax cross-entropy loss enables features from different emotion categories separable, and center loss efficiently pulls the features belonging to the same emotion category to their center. By combining the two losses together, the discriminative power will be highly enhanced, which leads to network learning more effective features for emotion recognition. As demonstrated by the experimental results, after introducing center loss, both the unweighted accuracy and weighted accuracy are improved by over 3\% on Mel-spectrogram input, and more than 4\% on Short Time Fourier Transform spectrogram input.
title learning discriminative features from spectrograms using center loss for speech emotion recognition
topic Audio and Speech Processing
Artificial Intelligence
Sound
url https://arxiv.org/abs/2501.01103