Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cao, Zhiyu, Li, Peifeng, Zhu, Qiaoming
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911575835672576
author Cao, Zhiyu
Li, Peifeng
Zhu, Qiaoming
author_facet Cao, Zhiyu
Li, Peifeng
Zhu, Qiaoming
contents Conversational Query Rewriting (CQR) aims to rewrite ambiguous queries to achieve more efficient conversational search. Early studies have predominantly focused on the rewriting in isolation, ignoring the feedback from query rewrite, passage retrieval and response generation in the rewriting process. To address this issue, we propose Multi-Faceted Self-Consistent Preference Aligned CQR (MSPA-CQR). Specifically, we first construct self-consistent preference alignment data from three dimensions (rewriting, retrieval, and response) to generate more diverse rewritten queries. Then we propose prefix guided multi-faceted direct preference optimization to learn preference information from three different dimensions. The experimental results show that our MSPA-CQR is effective in both in- and out-of-distribution scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2604_06771
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search
Cao, Zhiyu
Li, Peifeng
Zhu, Qiaoming
Computation and Language
Artificial Intelligence
Conversational Query Rewriting (CQR) aims to rewrite ambiguous queries to achieve more efficient conversational search. Early studies have predominantly focused on the rewriting in isolation, ignoring the feedback from query rewrite, passage retrieval and response generation in the rewriting process. To address this issue, we propose Multi-Faceted Self-Consistent Preference Aligned CQR (MSPA-CQR). Specifically, we first construct self-consistent preference alignment data from three dimensions (rewriting, retrieval, and response) to generate more diverse rewritten queries. Then we propose prefix guided multi-faceted direct preference optimization to learn preference information from three different dimensions. The experimental results show that our MSPA-CQR is effective in both in- and out-of-distribution scenarios.
title Multi-Faceted Self-Consistent Preference Alignment for Query Rewriting in Conversational Search
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2604.06771