Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2407.02345 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929406411276288 |
|---|---|
| author | Tang, Yihong Wang, Bo Zhao, Dongming Jin, Xiaojia Zhang, Jijun He, Ruifang Hou, Yuexian |
| author_facet | Tang, Yihong Wang, Bo Zhao, Dongming Jin, Xiaojia Zhang, Jijun He, Ruifang Hou, Yuexian |
| contents | Personalized Dialogue Generation (PDG) aims to create coherent responses according to roles or personas. Traditional PDG relies on external role data, which can be scarce and raise privacy concerns. Approaches address these issues by extracting role information from dialogue history, which often fail to generically model roles in continuous space. To overcome these limitations, we introduce a novel framework \textbf{MO}dels \textbf{R}oles from \textbf{P}ersonalized Dialogue \textbf{H}istory by \textbf{E}xploring and \textbf{U}tilizing Latent \textbf{S}pace (MORPHEUS) through a three-stage training process. Specifically, we create a persona codebook to represent roles in latent space compactly, and this codebook is used to construct a posterior distribution of role information. This method enables the model to generalize across roles, allowing the generation of personalized dialogues even for unseen roles. Experiments on both Chinese and English datasets demonstrate that MORPHEUS enhances the extraction of role information, and improves response generation without external role data. Additionally, MORPHEUS can be considered an efficient fine-tuning for large language models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_02345 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space Tang, Yihong Wang, Bo Zhao, Dongming Jin, Xiaojia Zhang, Jijun He, Ruifang Hou, Yuexian Computation and Language Personalized Dialogue Generation (PDG) aims to create coherent responses according to roles or personas. Traditional PDG relies on external role data, which can be scarce and raise privacy concerns. Approaches address these issues by extracting role information from dialogue history, which often fail to generically model roles in continuous space. To overcome these limitations, we introduce a novel framework \textbf{MO}dels \textbf{R}oles from \textbf{P}ersonalized Dialogue \textbf{H}istory by \textbf{E}xploring and \textbf{U}tilizing Latent \textbf{S}pace (MORPHEUS) through a three-stage training process. Specifically, we create a persona codebook to represent roles in latent space compactly, and this codebook is used to construct a posterior distribution of role information. This method enables the model to generalize across roles, allowing the generation of personalized dialogues even for unseen roles. Experiments on both Chinese and English datasets demonstrate that MORPHEUS enhances the extraction of role information, and improves response generation without external role data. Additionally, MORPHEUS can be considered an efficient fine-tuning for large language models. |
| title | MORPHEUS: Modeling Role from Personalized Dialogue History by Exploring and Utilizing Latent Space |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2407.02345 |