Can we predict QPP? An approach based on multivariate outliers
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909209690374144 |
|---|---|
| author | Chifu, Adrian-Gabriel Déjean, Sébastien Garouani, Moncef Mothe, Josiane Ortiz, Diégo Ullah, Md Zia |
| author_facet | Chifu, Adrian-Gabriel Déjean, Sébastien Garouani, Moncef Mothe, Josiane Ortiz, Diégo Ullah, Md Zia |
| contents | Query performance prediction (QPP) aims to forecast the effectiveness of a search engine across a range of queries and documents. While state-of-the-art predictors offer a certain level of precision, their accuracy is not flawless. Prior research has recognized the challenges inherent in QPP but often lacks a thorough qualitative analysis. In this paper, we delve into QPP by examining the factors that influence the predictability of query performance accuracy. We propose the working hypothesis that while some queries are readily predictable, others present significant challenges. By focusing on outliers, we aim to identify the queries that are particularly challenging to predict. To this end, we employ multivariate outlier detection method. Our results demonstrate the effectiveness of this approach in identifying queries on which QPP do not perform well, yielding less reliable predictions. Moreover, we provide evidence that excluding these hard-to-predict queries from the analysis significantly enhances the overall accuracy of QPP. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_16875 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Can we predict QPP? An approach based on multivariate outliers Chifu, Adrian-Gabriel Déjean, Sébastien Garouani, Moncef Mothe, Josiane Ortiz, Diégo Ullah, Md Zia Information Retrieval H.3.3 Query performance prediction (QPP) aims to forecast the effectiveness of a search engine across a range of queries and documents. While state-of-the-art predictors offer a certain level of precision, their accuracy is not flawless. Prior research has recognized the challenges inherent in QPP but often lacks a thorough qualitative analysis. In this paper, we delve into QPP by examining the factors that influence the predictability of query performance accuracy. We propose the working hypothesis that while some queries are readily predictable, others present significant challenges. By focusing on outliers, we aim to identify the queries that are particularly challenging to predict. To this end, we employ multivariate outlier detection method. Our results demonstrate the effectiveness of this approach in identifying queries on which QPP do not perform well, yielding less reliable predictions. Moreover, we provide evidence that excluding these hard-to-predict queries from the analysis significantly enhances the overall accuracy of QPP. |
| title | Can we predict QPP? An approach based on multivariate outliers |
| topic | Information Retrieval H.3.3 |
| url | https://arxiv.org/abs/2402.16875 |