Improving Conversational Recommendation Systems via Counterfactual Data Simulation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Xiaolei, Zhou, Kun, Tang, Xinyu, Zhao, Wayne Xin, Pan, Fan, Cao, Zhao, Wen, Ji-Rong
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916294511558656
author Wang, Xiaolei
Zhou, Kun
Tang, Xinyu
Zhao, Wayne Xin
Pan, Fan
Cao, Zhao
Wen, Ji-Rong
author_facet Wang, Xiaolei
Zhou, Kun
Tang, Xinyu
Zhao, Wayne Xin
Pan, Fan
Cao, Zhao
Wen, Ji-Rong
contents Conversational recommender systems (CRSs) aim to provide recommendation services via natural language conversations. Although a number of approaches have been proposed for developing capable CRSs, they typically rely on sufficient training data for training. Since it is difficult to annotate recommendation-oriented dialogue datasets, existing CRS approaches often suffer from the issue of insufficient training due to the scarcity of training data. To address this issue, in this paper, we propose a CounterFactual data simulation approach for CRS, named CFCRS, to alleviate the issue of data scarcity in CRSs. Our approach is developed based on the framework of counterfactual data augmentation, which gradually incorporates the rewriting to the user preference from a real dialogue without interfering with the entire conversation flow. To develop our approach, we characterize user preference and organize the conversation flow by the entities involved in the dialogue, and design a multi-stage recommendation dialogue simulator based on a conversation flow language model. Under the guidance of the learned user preference and dialogue schema, the flow language model can produce reasonable, coherent conversation flows, which can be further realized into complete dialogues. Based on the simulator, we perform the intervention at the representations of the interacted entities of target users, and design an adversarial training method with a curriculum schedule that can gradually optimize the data augmentation strategy. Extensive experiments show that our approach can consistently boost the performance of several competitive CRSs, and outperform other data augmentation methods, especially when the training data is limited. Our code is publicly available at https://github.com/RUCAIBox/CFCRS.
format Preprint
id arxiv_https___arxiv_org_abs_2306_02842
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Improving Conversational Recommendation Systems via Counterfactual Data Simulation
Wang, Xiaolei
Zhou, Kun
Tang, Xinyu
Zhao, Wayne Xin
Pan, Fan
Cao, Zhao
Wen, Ji-Rong
Computation and Language
Information Retrieval
Conversational recommender systems (CRSs) aim to provide recommendation services via natural language conversations. Although a number of approaches have been proposed for developing capable CRSs, they typically rely on sufficient training data for training. Since it is difficult to annotate recommendation-oriented dialogue datasets, existing CRS approaches often suffer from the issue of insufficient training due to the scarcity of training data. To address this issue, in this paper, we propose a CounterFactual data simulation approach for CRS, named CFCRS, to alleviate the issue of data scarcity in CRSs. Our approach is developed based on the framework of counterfactual data augmentation, which gradually incorporates the rewriting to the user preference from a real dialogue without interfering with the entire conversation flow. To develop our approach, we characterize user preference and organize the conversation flow by the entities involved in the dialogue, and design a multi-stage recommendation dialogue simulator based on a conversation flow language model. Under the guidance of the learned user preference and dialogue schema, the flow language model can produce reasonable, coherent conversation flows, which can be further realized into complete dialogues. Based on the simulator, we perform the intervention at the representations of the interacted entities of target users, and design an adversarial training method with a curriculum schedule that can gradually optimize the data augmentation strategy. Extensive experiments show that our approach can consistently boost the performance of several competitive CRSs, and outperform other data augmentation methods, especially when the training data is limited. Our code is publicly available at https://github.com/RUCAIBox/CFCRS.
title Improving Conversational Recommendation Systems via Counterfactual Data Simulation
topic Computation and Language
Information Retrieval
url https://arxiv.org/abs/2306.02842