Saved in:
Bibliographic Details
Main Authors: Litvinov, Oleg, Sekulić, Ivan, Aliannejadi, Mohammad, Crestani, Fabio
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.04524
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • Clarifying user's information needs is an essential component of modern search systems. While most of the approaches for constructing clarifying prompts rely on query facets, the impact of the quality of the facets is relatively unexplored. In this work, we concentrate on facet quality through the notion of facet coherency and assess its importance for overall usefulness for clarification in search. We find that existing evaluation procedures do not account for facet coherency, as evident by the poor correlation of coherency with automated metrics. Moreover, we propose a coherency classifier and assess the prevalence of incoherent facets in a well-established dataset on clarification. Our findings can serve as motivation for future work on the topic.