Meta-PerSER: Few-Shot Listener Personalized Speech Emotion Recognition via Meta-learning
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866918030143913984 |
|---|---|
| author | Shen, Liang-Yeh Fang, Shi-Xin Lin, Yi-Cheng Chou, Huang-Cheng Lee, Hung-yi |
| author_facet | Shen, Liang-Yeh Fang, Shi-Xin Lin, Yi-Cheng Chou, Huang-Cheng Lee, Hung-yi |
| contents | This paper introduces Meta-PerSER, a novel meta-learning framework that personalizes Speech Emotion Recognition (SER) by adapting to each listener's unique way of interpreting emotion. Conventional SER systems rely on aggregated annotations, which often overlook individual subtleties and lead to inconsistent predictions. In contrast, Meta-PerSER leverages a Model-Agnostic Meta-Learning (MAML) approach enhanced with Combined-Set Meta-Training, Derivative Annealing, and per-layer per-step learning rates, enabling rapid adaptation with only a few labeled examples. By integrating robust representations from pre-trained self-supervised models, our framework first captures general emotional cues and then fine-tunes itself to personal annotation styles. Experiments on the IEMOCAP corpus demonstrate that Meta-PerSER significantly outperforms baseline methods in both seen and unseen data scenarios, highlighting its promise for personalized emotion recognition. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_16220 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Meta-PerSER: Few-Shot Listener Personalized Speech Emotion Recognition via Meta-learning Shen, Liang-Yeh Fang, Shi-Xin Lin, Yi-Cheng Chou, Huang-Cheng Lee, Hung-yi Audio and Speech Processing Computation and Language This paper introduces Meta-PerSER, a novel meta-learning framework that personalizes Speech Emotion Recognition (SER) by adapting to each listener's unique way of interpreting emotion. Conventional SER systems rely on aggregated annotations, which often overlook individual subtleties and lead to inconsistent predictions. In contrast, Meta-PerSER leverages a Model-Agnostic Meta-Learning (MAML) approach enhanced with Combined-Set Meta-Training, Derivative Annealing, and per-layer per-step learning rates, enabling rapid adaptation with only a few labeled examples. By integrating robust representations from pre-trained self-supervised models, our framework first captures general emotional cues and then fine-tunes itself to personal annotation styles. Experiments on the IEMOCAP corpus demonstrate that Meta-PerSER significantly outperforms baseline methods in both seen and unseen data scenarios, highlighting its promise for personalized emotion recognition. |
| title | Meta-PerSER: Few-Shot Listener Personalized Speech Emotion Recognition via Meta-learning |
| topic | Audio and Speech Processing Computation and Language |
| url | https://arxiv.org/abs/2505.16220 |