BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xue, Jieying, Nguyen, Minh Phuong, Matheny, Blake, Nguyen, Le Minh
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917781170028544
author Xue, Jieying
Nguyen, Minh Phuong
Matheny, Blake
Nguyen, Le Minh
author_facet Xue, Jieying
Nguyen, Minh Phuong
Matheny, Blake
Nguyen, Le Minh
contents In the Emotion Recognition in Conversation task, recent investigations have utilized attention mechanisms exploring relationships among utterances from intra- and inter-speakers for modeling emotional interaction between them. However, attributes such as speaker personality traits remain unexplored and present challenges in terms of their applicability to other tasks or compatibility with diverse model architectures. Therefore, this work introduces a novel framework named BiosERC, which investigates speaker characteristics in a conversation. By employing Large Language Models (LLMs), we extract the "biographical information" of the speaker within a conversation as supplementary knowledge injected into the model to classify emotional labels for each utterance. Our proposed method achieved state-of-the-art (SOTA) results on three famous benchmark datasets: IEMOCAP, MELD, and EmoryNLP, demonstrating the effectiveness and generalization of our model and showcasing its potential for adaptation to various conversation analysis tasks. Our source code is available at https://github.com/yingjie7/BiosERC.
format Preprint
id arxiv_https___arxiv_org_abs_2407_04279
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks
Xue, Jieying
Nguyen, Minh Phuong
Matheny, Blake
Nguyen, Le Minh
Computation and Language
Machine Learning
Sound
Audio and Speech Processing
In the Emotion Recognition in Conversation task, recent investigations have utilized attention mechanisms exploring relationships among utterances from intra- and inter-speakers for modeling emotional interaction between them. However, attributes such as speaker personality traits remain unexplored and present challenges in terms of their applicability to other tasks or compatibility with diverse model architectures. Therefore, this work introduces a novel framework named BiosERC, which investigates speaker characteristics in a conversation. By employing Large Language Models (LLMs), we extract the "biographical information" of the speaker within a conversation as supplementary knowledge injected into the model to classify emotional labels for each utterance. Our proposed method achieved state-of-the-art (SOTA) results on three famous benchmark datasets: IEMOCAP, MELD, and EmoryNLP, demonstrating the effectiveness and generalization of our model and showcasing its potential for adaptation to various conversation analysis tasks. Our source code is available at https://github.com/yingjie7/BiosERC.
title BiosERC: Integrating Biography Speakers Supported by LLMs for ERC Tasks
topic Computation and Language
Machine Learning
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2407.04279