Advancing Multi-Party Dialogue Framework with Speaker-ware Contrastive Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hu, Zhongtian, He, Qi, Li, Ronghan, Zhao, Meng, Wang, Lifang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910952614526976
author Hu, Zhongtian
He, Qi
Li, Ronghan
Zhao, Meng
Wang, Lifang
author_facet Hu, Zhongtian
He, Qi
Li, Ronghan
Zhao, Meng
Wang, Lifang
contents Multi-party dialogues, common in collaborative scenarios like brainstorming sessions and negotiations, pose significant challenges due to their complexity and diverse speaker roles. Current methods often use graph neural networks to model dialogue context, capturing structural dynamics but heavily relying on annotated graph structures and overlooking individual speaking styles. To address these challenges, we propose CMR, a Contrastive learning-based Multi-party dialogue Response generation framework. CMR employs a two-stage self-supervised contrastive learning framework. First, it captures global differences in speaking styles across individuals. Then, it focuses on intra-conversation comparisons to identify thematic transitions and contextually relevant facts. To the best of our knowledge, this is the first approach that applies contrastive learning in multi-party dialogue generation. Experimental results demonstrate that CMR not only significantly outperforms state-of-the-art models, but also generalizes well to large pre-trained language models, effectively enhancing their capability in handling multi-party conversations.
format Preprint
id arxiv_https___arxiv_org_abs_2501_11292
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Advancing Multi-Party Dialogue Framework with Speaker-ware Contrastive Learning
Hu, Zhongtian
He, Qi
Li, Ronghan
Zhao, Meng
Wang, Lifang
Computation and Language
Multi-party dialogues, common in collaborative scenarios like brainstorming sessions and negotiations, pose significant challenges due to their complexity and diverse speaker roles. Current methods often use graph neural networks to model dialogue context, capturing structural dynamics but heavily relying on annotated graph structures and overlooking individual speaking styles. To address these challenges, we propose CMR, a Contrastive learning-based Multi-party dialogue Response generation framework. CMR employs a two-stage self-supervised contrastive learning framework. First, it captures global differences in speaking styles across individuals. Then, it focuses on intra-conversation comparisons to identify thematic transitions and contextually relevant facts. To the best of our knowledge, this is the first approach that applies contrastive learning in multi-party dialogue generation. Experimental results demonstrate that CMR not only significantly outperforms state-of-the-art models, but also generalizes well to large pre-trained language models, effectively enhancing their capability in handling multi-party conversations.
title Advancing Multi-Party Dialogue Framework with Speaker-ware Contrastive Learning
topic Computation and Language
url https://arxiv.org/abs/2501.11292