Validating Search Query Simulations: A Taxonomy of Measures

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Kruff, Andreas Konstantin, Bernard, Nolwenn, Schaer, Philipp
Format:	Preprint
Published:	2026
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Evaluating Contrastive Feedback for Effective User Simulations
by: Kruff, Andreas Konstantin, et al.
Published: (2025)

Sim4IA-Bench: A User Simulation Benchmark Suite for Next Query and Utterance Prediction
by: Kruff, Andreas Konstantin, et al.
Published: (2025)

LISP -- A Rich Interaction Dataset and Loggable Interactive Search Platform
by: Friese, Jana Isabelle, et al.
Published: (2026)

Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025)
by: Schaer, Philipp, et al.
Published: (2025)

Scientometric Analysis of the German IR Community within TREC & CLEF
by: Kruff, A. K., et al.
Published: (2025)

Identifying Breakdowns in Conversational Recommender Systems using User Simulation
by: Bernard, Nolwenn, et al.
Published: (2024)

Towards a Formal Characterization of User Simulation Objectives in Conversational Information Access
by: Bernard, Nolwenn, et al.
Published: (2024)

Limitations of Current Evaluation Practices for Conversational Recommender Systems and the Potential of User Simulation
by: Bernard, Nolwenn, et al.
Published: (2025)

UserSimCRS v2: Simulation-Based Evaluation for Conversational Recommender Systems
by: Bernard, Nolwenn, et al.
Published: (2025)

Auditing Search Query Suggestion Bias Through Recursive Algorithm Interrogation
by: Haak, Fabian, et al.
Published: (2026)

Context-Driven Interactive Query Simulations Based on Generative Large Language Models
by: Engelmann, Björn, et al.
Published: (2023)

Replicability Measures for Longitudinal Information Retrieval Evaluation
by: Keller, Jüri, et al.
Published: (2024)

Investigating Bias in Political Search Query Suggestions by Relative Comparison with LLMs
by: Haak, Fabian, et al.
Published: (2024)

Simplified Longitudinal Retrieval Experiments: A Case Study on Query Expansion and Document Boosting
by: Keller, Jüri, et al.
Published: (2025)

IAI MovieBot 2.0: An Enhanced Research Platform with Trainable Neural Components and Transparent User Modeling
by: Bernard, Nolwenn, et al.
Published: (2024)

SimLab: A Platform for Simulation-based Evaluation of Conversational Information Access Systems
by: Bernard, Nolwenn, et al.
Published: (2025)

Counterfactual Query Rewriting to Use Historical Relevance Feedback
by: Keller, Jüri, et al.
Published: (2025)

Evaluation of Temporal Change in IR Test Collections
by: Keller, Jüri, et al.
Published: (2024)

CRS Arena: Crowdsourced Benchmarking of Conversational Recommender Systems
by: Bernard, Nolwenn, et al.
Published: (2024)

Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024
by: Breuer, Timo, et al.
Published: (2024)

Dynamics in Search Engine Query Suggestions for European Politicians
by: Pradel, Franziska, et al.
Published: (2026)

QueryExplorer: An Interactive Query Generation Assistant for Search and Exploration
by: Dhole, Kaustubh D., et al.
Published: (2024)

An Ecosystem for Personal Knowledge Graphs: A Survey and Research Roadmap
by: Skjæveland, Martin G., et al.
Published: (2023)

Improving Search Suggestions for Alphanumeric Queries
by: Agrawal, Samarth, et al.
Published: (2026)

REANIMATOR: Reanimate Retrieval Test Collections with Extracted and Synthetic Resources
by: Engelmann, Björn, et al.
Published: (2025)

Taxonomy-based Negative Sampling In Personalized Semantic Search for E-commerce
by: Jinadu, Uthman, et al.
Published: (2025)

Exploring Query Understanding for Amazon Product Search
by: Luo, Chen, et al.
Published: (2024)

Generating Multi-Aspect Queries for Conversational Search
by: Abbasiantaeb, Zahra, et al.
Published: (2024)

Searching COVID-19 Clinical Research Using Graph Queries: Algorithm Development and Validation
by: Invernici, Francesco, et al.
Published: (2023)

Don't Measure Once: Measuring Visibility in AI Search (GEO)
by: Schulte, Julius, et al.
Published: (2026)

Queries Are Not Alone: Clustering Text Embeddings for Video Search
by: Liu, Peyang, et al.
Published: (2025)

TongSearch-QR: Reinforced Query Reasoning for Retrieval
by: Qin, Xubo, et al.
Published: (2025)

CTR-Guided Generative Query Suggestion in Conversational Search
by: Min, Erxue, et al.
Published: (2025)

Perception-Aware Bias Detection for Query Suggestions
by: Haak, Fabian, et al.
Published: (2026)

Taxonomy and Analysis of Sensitive User Queries in Generative AI Search
by: Jo, Hwiyeol, et al.
Published: (2024)

LLM-based Semantic Search for Conversational Queries in E-commerce
by: Siddiqui, Emad, et al.
Published: (2026)

A Data-Centric Approach to Multilingual E-Commerce Product Search: Case Study on Query-Category and Query-Item Relevance
by: Yin, Yabo, et al.
Published: (2025)

Exploiting Positional Bias for Query-Agnostic Generative Content in Search
by: Parry, Andrew, et al.
Published: (2024)

Taxonomy-guided Semantic Indexing for Academic Paper Search
by: Kang, SeongKu, et al.
Published: (2024)

Towards Scalability and Extensibility of Query Reformulation Modeling in E-commerce Search
by: Zhang, Ziqi, et al.
Published: (2024)