Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ihori, Mana, Yamane, Taiga, Kawata, Naotaka, Makishima, Naoki, Tanaka, Tomohiro, Suzuki, Satoshi, Orihashi, Shota, Masumura, Ryo
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2509.08344
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909780220575744
author Ihori, Mana
Yamane, Taiga
Kawata, Naotaka
Makishima, Naoki
Tanaka, Tomohiro
Suzuki, Satoshi
Orihashi, Shota
Masumura, Ryo
author_facet Ihori, Mana
Yamane, Taiga
Kawata, Naotaka
Makishima, Naoki
Tanaka, Tomohiro
Suzuki, Satoshi
Orihashi, Shota
Masumura, Ryo
contents This paper proposes a personalization method for speech emotion recognition (SER) through in-context learning (ICL). Since the expression of emotions varies from person to person, speaker-specific adaptation is crucial for improving the SER performance. Conventional SER methods have been personalized using emotional utterances of a target speaker, but it is often difficult to prepare utterances corresponding to all emotion labels in advance. Our idea to overcome this difficulty is to obtain speaker characteristics by conditioning a few emotional utterances of the target speaker in ICL-based inference. ICL is a method to perform unseen tasks by conditioning a few input-output examples through inference in large language models (LLMs). We meta-train a speech-language model extended from the LLM to learn how to perform personalized SER via ICL. Experimental results using our newly collected SER dataset demonstrate that the proposed method outperforms conventional methods.
format Preprint
id arxiv_https___arxiv_org_abs_2509_08344
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Few-shot Personalization via In-Context Learning for Speech Emotion Recognition based on Speech-Language Model
Ihori, Mana
Yamane, Taiga
Kawata, Naotaka
Makishima, Naoki
Tanaka, Tomohiro
Suzuki, Satoshi
Orihashi, Shota
Masumura, Ryo
Audio and Speech Processing
This paper proposes a personalization method for speech emotion recognition (SER) through in-context learning (ICL). Since the expression of emotions varies from person to person, speaker-specific adaptation is crucial for improving the SER performance. Conventional SER methods have been personalized using emotional utterances of a target speaker, but it is often difficult to prepare utterances corresponding to all emotion labels in advance. Our idea to overcome this difficulty is to obtain speaker characteristics by conditioning a few emotional utterances of the target speaker in ICL-based inference. ICL is a method to perform unseen tasks by conditioning a few input-output examples through inference in large language models (LLMs). We meta-train a speech-language model extended from the LLM to learn how to perform personalized SER via ICL. Experimental results using our newly collected SER dataset demonstrate that the proposed method outperforms conventional methods.
title Few-shot Personalization via In-Context Learning for Speech Emotion Recognition based on Speech-Language Model
topic Audio and Speech Processing
url https://arxiv.org/abs/2509.08344