Copertina

SimLab: A Platform for Simulation-based Evaluation of Conversational Information Access Systems

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Bernard, Nolwenn, Suresh, Sharath Chandra Etagi, Balog, Krisztian, Zhai, ChengXiang
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Information Retrieval
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

UserSimCRS v2: Simulation-Based Evaluation for Conversational Recommender Systems
di: Bernard, Nolwenn, et al.
Pubblicazione: (2025)

User Simulation for Evaluating Information Access Systems
di: Balog, Krisztian, et al.
Pubblicazione: (2023)

Towards a Formal Characterization of User Simulation Objectives in Conversational Information Access
di: Bernard, Nolwenn, et al.
Pubblicazione: (2024)

Limitations of Current Evaluation Practices for Conversational Recommender Systems and the Potential of User Simulation
di: Bernard, Nolwenn, et al.
Pubblicazione: (2025)

Identifying Breakdowns in Conversational Recommender Systems using User Simulation
di: Bernard, Nolwenn, et al.
Pubblicazione: (2024)

User Simulation in the Era of Generative AI: User Modeling, Synthetic Data Generation, and System Evaluation
di: Balog, Krisztian, et al.
Pubblicazione: (2025)

IAI MovieBot 2.0: An Enhanced Research Platform with Trainable Neural Components and Transparent User Modeling
di: Bernard, Nolwenn, et al.
Pubblicazione: (2024)

CRS Arena: Crowdsourced Benchmarking of Conversational Recommender Systems
di: Bernard, Nolwenn, et al.
Pubblicazione: (2024)

Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024
di: Breuer, Timo, et al.
Pubblicazione: (2024)

A Standardized Re-evaluation of Conversational Recommender Systems on the ReDial Dataset
di: Kostric, Ivica, et al.
Pubblicazione: (2026)

Towards Reliable and Factual Response Generation: Detecting Unanswerable Questions in Information-Seeking Conversations
di: Łajewska, Weronika, et al.
Pubblicazione: (2024)

A Surprisingly Simple yet Effective Multi-Query Rewriting Method for Conversational Passage Retrieval
di: Kostric, Ivica, et al.
Pubblicazione: (2024)

Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025)
di: Schaer, Philipp, et al.
Pubblicazione: (2025)

An Ecosystem for Personal Knowledge Graphs: A Survey and Research Roadmap
di: Skjæveland, Martin G., et al.
Pubblicazione: (2023)

Make Any Collection Navigable: Methods for Constructing and Evaluating Hypergraph of Text
di: Alvarez, Dean E., et al.
Pubblicazione: (2026)

Interactive Information Need Prediction with Intent and Context
di: Ros, Kevin, et al.
Pubblicazione: (2025)

Should We Tailor the Talk? Understanding the Impact of Conversational Styles on Preference Elicitation in Conversational Recommender Systems
di: Kostric, Ivica, et al.
Pubblicazione: (2025)

Can Users Detect Biases or Factual Errors in Generated Responses in Conversational Information-Seeking?
di: Łajewska, Weronika, et al.
Pubblicazione: (2024)

Sim4IA-Bench: A User Simulation Benchmark Suite for Next Query and Utterance Prediction
di: Kruff, Andreas Konstantin, et al.
Pubblicazione: (2025)

GINGER: Grounded Information Nugget-Based Generation of Responses
di: Łajewska, Weronika, et al.
Pubblicazione: (2025)

Explainability for Transparent Conversational Information-Seeking
di: Łajewska, Weronika, et al.
Pubblicazione: (2024)

Trust Me on This: A User Study of Trustworthiness for RAG Responses
di: Łajewska, Weronika, et al.
Pubblicazione: (2026)

SciNUP: Natural Language User Interest Profiles for Scientific Literature Recommendation
di: Arustashvili, Mariam, et al.
Pubblicazione: (2025)

Generating Usage-related Questions for Preference Elicitation in Conversational Recommender Systems
di: Kostric, Ivica, et al.
Pubblicazione: (2021)

Towards Self-Contained Answers: Entity-Based Answer Rewriting in Conversational Search
di: Sekulić, Ivan, et al.
Pubblicazione: (2024)

Know Your Users! Estimating User Domain Knowledge in Conversational Recommenders
di: Kostric, Ivica, et al.
Pubblicazione: (2025)

The Indispensable Role of User Simulation in the Pursuit of AGI
di: Balog, Krisztian, et al.
Pubblicazione: (2025)

Rankers, Judges, and Assistants: Towards Understanding the Interplay of LLMs in Information Retrieval Evaluation
di: Balog, Krisztian, et al.
Pubblicazione: (2025)

Estimating the Usefulness of Clarifying Questions and Answers for Conversational Search
di: Sekulić, Ivan, et al.
Pubblicazione: (2024)

Dataset and Models for Item Recommendation Using Multi-Modal User Interactions
di: Bruun, Simone Borg, et al.
Pubblicazione: (2024)

Validating Search Query Simulations: A Taxonomy of Measures
di: Kruff, Andreas Konstantin, et al.
Pubblicazione: (2026)

JIR-Arena: The First Benchmark Dataset for Just-in-time Information Recommendation
di: Yang, Ke, et al.
Pubblicazione: (2025)

UiS-IAI@LiveRAG: Retrieval-Augmented Information Nugget-Based Generation of Responses
di: Łajewska, Weronika, et al.
Pubblicazione: (2025)

AgentSim: A Platform for Verifiable Agent-Trace Simulation
di: Zerhoudi, Saber, et al.
Pubblicazione: (2026)

User Preference Modeling for Conversational LLM Agents: Weak Rewards from Retrieval-Augmented Interaction
di: Hao, Yuren, et al.
Pubblicazione: (2026)

FACE: A Fine-Grained Reference-Free Evaluator for Conversational Information Access
di: Joko, Hideaki, et al.
Pubblicazione: (2025)

WildClaims: Information Access Conversations in the Wild(Chat)
di: Joko, Hideaki, et al.
Pubblicazione: (2025)

User Simulator-Guided Multi-Turn Preference Optimization for Reasoning LLM-based Conversational Recommendation
di: Xiang, Xingyuan, et al.
Pubblicazione: (2026)

SimUSER: Simulating User Behavior with Large Language Models for Recommender System Evaluation
di: Bougie, Nicolas, et al.
Pubblicazione: (2025)

Stop Playing the Guessing Game! Target-free User Simulation for Evaluating Conversational Recommender Systems
di: Kim, Sunghwan, et al.
Pubblicazione: (2024)