Revisiting Query Variants: The Advantage of Retrieval Over Generation of Query Variants for Effective QPP

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Tian, Fangzheng, Ganguly, Debasis, Macdonald, Craig
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914072398659584
author Tian, Fangzheng
Ganguly, Debasis
Macdonald, Craig
author_facet Tian, Fangzheng
Ganguly, Debasis
Macdonald, Craig
contents Leveraging query variants (QVs), i.e., queries with potentially similar information needs to the target query, has been shown to improve the effectiveness of query performance prediction (QPP) approaches. Existing QV-based QPP methods generate QVs facilitated by either query expansion or non-contextual embeddings, which may introduce topical drifts and hallucinations. In this paper, we propose a method that retrieves QVs from a training set (e.g., MS MARCO) for a given target query of QPP. To achieve a high recall in retrieving queries with the most similar information needs as the target query from a training set, we extend the directly retrieved QVs (1-hop QVs) by a second retrieval using their denoted relevant documents (which yields 2-hop QVs). Our experiments, conducted on TREC DL'19 and DL'20, show that the QPP methods with QVs retrieved by our method outperform the best-performing existing generated-QV-based QPP approaches by as much as around 20\%, on neural ranking models like MonoT5.
format Preprint
id arxiv_https___arxiv_org_abs_2510_02512
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Revisiting Query Variants: The Advantage of Retrieval Over Generation of Query Variants for Effective QPP
Tian, Fangzheng
Ganguly, Debasis
Macdonald, Craig
Information Retrieval
Leveraging query variants (QVs), i.e., queries with potentially similar information needs to the target query, has been shown to improve the effectiveness of query performance prediction (QPP) approaches. Existing QV-based QPP methods generate QVs facilitated by either query expansion or non-contextual embeddings, which may introduce topical drifts and hallucinations. In this paper, we propose a method that retrieves QVs from a training set (e.g., MS MARCO) for a given target query of QPP. To achieve a high recall in retrieving queries with the most similar information needs as the target query from a training set, we extend the directly retrieved QVs (1-hop QVs) by a second retrieval using their denoted relevant documents (which yields 2-hop QVs). Our experiments, conducted on TREC DL'19 and DL'20, show that the QPP methods with QVs retrieved by our method outperform the best-performing existing generated-QV-based QPP approaches by as much as around 20\%, on neural ranking models like MonoT5.
title Revisiting Query Variants: The Advantage of Retrieval Over Generation of Query Variants for Effective QPP
topic Information Retrieval
url https://arxiv.org/abs/2510.02512