Imagen de Portada

SimEval-IR: A Unified Toolkit and Benchmark Suite for Evaluating User Simulators and Search Sessions

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Zerhoudi, Saber
Formato:	Preprint
Publicado:	2026
Materias:	Information Retrieval
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

UXSim: Towards a Hybrid User Search Simulation
por: Zerhoudi, Saber, et al.
Publicado: (2026)

AgentSim: A Platform for Verifiable Agent-Trace Simulation
por: Zerhoudi, Saber, et al.
Publicado: (2026)

OpenIIR: An Open Simulation Platform for Information Retrieval Research
por: Zerhoudi, Saber
Publicado: (2026)

PersonaRAG: Enhancing Retrieval-Augmented Generation Systems with User-Centric Agents
por: Zerhoudi, Saber, et al.
Publicado: (2024)

IIRSim Studio: A Dashboard for User Simulation
por: Zerhoudi, Saber, et al.
Publicado: (2026)

In-Browser Agents for Search Assistance
por: Zerhoudi, Saber, et al.
Publicado: (2026)

Beyond the Click: A Framework for Inferring Cognitive Traces in Search
por: Zerhoudi, Saber, et al.
Publicado: (2026)

Sim4IA-Bench: A User Simulation Benchmark Suite for Next Query and Utterance Prediction
por: Kruff, Andreas Konstantin, et al.
Publicado: (2025)

Beyond Benchmarks: Evaluating Embedding Model Similarity for Retrieval Augmented Generation Systems
por: Caspari, Laura, et al.
Publicado: (2024)

From SERPs to Agents: A Platform for Comparative Studies of Information Interaction
por: Zerhoudi, Saber, et al.
Publicado: (2026)

SuiteEval: Simplifying Retrieval Benchmarks
por: Parry, Andrew, et al.
Publicado: (2026)

NuggetIndex: Governed Atomic Retrieval for Maintainable RAG
por: Zerhoudi, Saber, et al.
Publicado: (2026)

Generative Agents Navigating Digital Libraries
por: Zerhoudi, Saber, et al.
Publicado: (2026)

Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024
por: Breuer, Timo, et al.
Publicado: (2024)

OwlerLite: Scope- and Freshness-Aware Web Retrieval for LLM Assistants
por: Zerhoudi, Saber, et al.
Publicado: (2026)

UserSimCRS v2: Simulation-Based Evaluation for Conversational Recommender Systems
por: Bernard, Nolwenn, et al.
Publicado: (2025)

LogEval: A Comprehensive Benchmark Suite for Large Language Models In Log Analysis
por: Cui, Tianyu, et al.
Publicado: (2024)

LongEval at CLEF 2025: Longitudinal Evaluation of IR Model Performance
por: Cancellieri, Matteo, et al.
Publicado: (2025)

Behind the Prompt: The Agent-User Problem in Information Retrieval
por: Zerhoudi, Saber, et al.
Publicado: (2026)

NineRec: A Benchmark Dataset Suite for Evaluating Transferable Recommendation
por: Zhang, Jiaqi, et al.
Publicado: (2023)

ViLLA-MMBench: A Unified Benchmark Suite for LLM-Augmented Multimodal Movie Recommendation
por: Nazary, Fatemeh, et al.
Publicado: (2025)

LongEval at CLEF 2025: Longitudinal Evaluation of IR Systems on Web and Scientific Data
por: Cancellieri, Matteo, et al.
Publicado: (2025)

SimUSER: Simulating User Behavior with Large Language Models for Recommender System Evaluation
por: Bougie, Nicolas, et al.
Publicado: (2025)

Variations in Relevance Judgments and the Shelf Life of Test Collections
por: Parry, Andrew, et al.
Publicado: (2025)

An In-depth Investigation of User Response Simulation for Conversational Search
por: Wang, Zhenduo, et al.
Publicado: (2023)

SimLab: A Platform for Simulation-based Evaluation of Conversational Information Access Systems
por: Bernard, Nolwenn, et al.
Publicado: (2025)

Session-level Normalization and Click-through Data Enhancement for Session-based Evaluation
por: Chen, Haonan, et al.
Publicado: (2024)

Similarity-Based Supervised User Session Segmentation Method for Behavior Logs
por: Jin, Yongzhi, et al.
Publicado: (2025)

DS@GT at LongEval: Evaluating Temporal Performance in Web Search Systems and Topics with Two-Stage Retrieval
por: Miyaguchi, Anthony, et al.
Publicado: (2025)

Improving GenIR Systems Based on User Feedback
por: Ai, Qingyao, et al.
Publicado: (2025)

Tevatron 2.0: Unified Document Retrieval Toolkit across Scale, Language, and Modality
por: Ma, Xueguang, et al.
Publicado: (2025)

Total Recall QA: A Verifiable Evaluation Suite for Deep Research Agents
por: Rafiee, Mahta, et al.
Publicado: (2026)

Cognitively Biased Users Interacting with Algorithmically Biased Results in Whole-Session Search on Debated Topics
por: Wang, Ben, et al.
Publicado: (2024)

Enhancing Healthcare Search Intent Recognition with Query Representation Learning and Session Context
por: Sahijwani, Harshita Jagdish, et al.
Publicado: (2026)

A Comparison of Methods for Evaluating Generative IR
por: Arabzadeh, Negar, et al.
Publicado: (2024)

Query-oriented Data Augmentation for Session Search
por: Chen, Haonan, et al.
Publicado: (2024)

MiLQ: Benchmarking IR Models for Bilingual Web Search with Mixed Language Queries
por: Kim, Jonghwi, et al.
Publicado: (2025)

USimAgent: Large Language Models for Simulating Search Users
por: Zhang, Erhan, et al.
Publicado: (2024)

Unified Generative Search and Recommendation
por: Shi, Teng, et al.
Publicado: (2025)

Limitations of Current Evaluation Practices for Conversational Recommender Systems and the Potential of User Simulation
por: Bernard, Nolwenn, et al.
Publicado: (2025)