Gen-SER: When the generative model meets speech emotion recognition

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wang, Taihui, Zhao, Jinzheng, Chen, Rilin, Lei, Tong, Wang, Wenwu, Yu, Dong
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915758948220928
author Wang, Taihui
Zhao, Jinzheng
Chen, Rilin
Lei, Tong
Wang, Wenwu
Yu, Dong
author_facet Wang, Taihui
Zhao, Jinzheng
Chen, Rilin
Lei, Tong
Wang, Wenwu
Yu, Dong
contents Speech emotion recognition (SER) is crucial in speech understanding and generation. Most approaches are based on either classification models or large language models. Different from previous methods, we propose Gen-SER, a novel approach that reformulates SER as a distribution shift problem via generative models. We propose to project discrete class labels into a continuous space, and obtain the terminal distribution via sinusoidal taxonomy encoding. The target-matching-based generative model is adopted to transform the initial distribution into the terminal distribution efficiently. The classification is achieved by calculating the similarity of the generated terminal distribution and ground truth terminal distribution. The experimental results confirm the efficacy of the proposed method, demonstrating its extensibility to various speech-understanding tasks and suggesting its potential applicability to a broader range of classification tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2601_20573
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Gen-SER: When the generative model meets speech emotion recognition
Wang, Taihui
Zhao, Jinzheng
Chen, Rilin
Lei, Tong
Wang, Wenwu
Yu, Dong
Sound
Speech emotion recognition (SER) is crucial in speech understanding and generation. Most approaches are based on either classification models or large language models. Different from previous methods, we propose Gen-SER, a novel approach that reformulates SER as a distribution shift problem via generative models. We propose to project discrete class labels into a continuous space, and obtain the terminal distribution via sinusoidal taxonomy encoding. The target-matching-based generative model is adopted to transform the initial distribution into the terminal distribution efficiently. The classification is achieved by calculating the similarity of the generated terminal distribution and ground truth terminal distribution. The experimental results confirm the efficacy of the proposed method, demonstrating its extensibility to various speech-understanding tasks and suggesting its potential applicability to a broader range of classification tasks.
title Gen-SER: When the generative model meets speech emotion recognition
topic Sound
url https://arxiv.org/abs/2601.20573