Cover Image

On the Reliability of User-Centric Evaluation of Conversational Recommender Systems

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Müller, Michael, Mohammadi, Amir Reza, Peintner, Andreas, Gstrein, Beatriz Barroso, Specht, Günther, Zangerle, Eva
Format:	Preprint
Published:	2026
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Unsupervised Graph Embeddings for Session-based Recommendation with Item Features
by: Peintner, Andreas, et al.
Published: (2025)

Evaluating Conversational Recommender Systems via Large Language Models: A User-Centric Framework
by: Chen, Nuo, et al.
Published: (2025)

Integrating Vision-Centric Text Understanding for Conversational Recommender Systems
by: Yuan, Wei, et al.
Published: (2026)

Limitations of Current Evaluation Practices for Conversational Recommender Systems and the Potential of User Simulation
by: Bernard, Nolwenn, et al.
Published: (2025)

UserSimCRS v2: Simulation-Based Evaluation for Conversational Recommender Systems
by: Bernard, Nolwenn, et al.
Published: (2025)

Stop Playing the Guessing Game! Target-free User Simulation for Evaluating Conversational Recommender Systems
by: Kim, Sunghwan, et al.
Published: (2024)

Identifying Breakdowns in Conversational Recommender Systems using User Simulation
by: Bernard, Nolwenn, et al.
Published: (2024)

Enhancing Recommendation Explanations through User-Centric Refinement
by: Zhang, Jingsen, et al.
Published: (2025)

Decision-aware User Simulation Agent for Evaluating Conversational Recommender Systems
by: Li, Yuan-Chi, et al.
Published: (2026)

Support the Underground: Characteristics of Beyond-Mainstream Music Listeners
by: Kowald, Dominik, et al.
Published: (2021)

A Survey on Data-Centric Recommender Systems
by: Lai, Riwei, et al.
Published: (2024)

A Task-Centric Perspective on Recommendation Systems
by: Sun, Aixin
Published: (2025)

Learning Evolving Preferences: A Federated Continual Framework for User-Centric Recommendation
by: Zhang, Chunxu, et al.
Published: (2026)

PersonaRAG: Enhancing Retrieval-Augmented Generation Systems with User-Centric Agents
by: Zerhoudi, Saber, et al.
Published: (2024)

What Else Would I Like? A User Simulator using Alternatives for Improved Evaluation of Fashion Conversational Recommendation Systems
by: Vlachou, Maria, et al.
Published: (2024)

Generative Conversational Recommender System
by: Zhang, Sixiao, et al.
Published: (2026)

Federated Conversational Recommender System
by: Lin, Allen, et al.
Published: (2025)

HARPO: Hierarchical Agentic Reasoning for User-Aligned Conversational Recommendation
by: Raj, Subham, et al.
Published: (2026)

Empowering Retrieval-based Conversational Recommendation with Contrasting User Preferences
by: Kook, Heejin, et al.
Published: (2025)

Breaking User-Centric Agency: A Tri-Party Framework for Agent-Based Recommendation
by: Gong, Yaxin, et al.
Published: (2026)

Snippet-based Conversational Recommender System
by: Sun, Haibo, et al.
Published: (2024)

Failure Prediction in Conversational Recommendation Systems
by: Vlachou, Maria
Published: (2025)

Evaluating and Addressing Fairness Across User Groups in Negative Sampling for Recommender Systems
by: Xuan, Yueqing, et al.
Published: (2023)

The Next Paradigm Is User-Centric Agent, Not Platform-Centric Service
by: Zhang, Luankang, et al.
Published: (2026)

On Mitigating Data Sparsity in Conversational Recommender Systems
by: Zhang, Sixiao, et al.
Published: (2025)

The Role of Fake Users in Sequential Recommender Systems
by: Betello, Filippo
Published: (2024)

Topic-Centric Explanations for News Recommendation
by: Liu, Dairui, et al.
Published: (2023)

Knowledge-Enhanced Recommendation with User-Centric Subgraph Network
by: Liu, Guangyi, et al.
Published: (2024)

CRS Arena: Crowdsourced Benchmarking of Conversational Recommender Systems
by: Bernard, Nolwenn, et al.
Published: (2024)

De-centering the (Traditional) User: Multistakeholder Evaluation of Recommender Systems
by: Burke, Robin, et al.
Published: (2025)

Evaluating Large Language Models as Generative User Simulators for Conversational Recommendation
by: Yoon, Se-eun, et al.
Published: (2024)

A Serendipitous Recommendation System Considering User Curiosity
by: Xu, Zhelin, et al.
Published: (2025)

Uplift Modeling for Target User Attacks on Recommender Systems
by: Wang, Wenjie, et al.
Published: (2024)

User Simulator-Guided Multi-Turn Preference Optimization for Reasoning LLM-based Conversational Recommendation
by: Xiang, Xingyuan, et al.
Published: (2026)

Exploring Recommender System Evaluation: A Multi-Modal User Agent Framework for A/B Testing
by: Zhang, Wenlin, et al.
Published: (2026)

A Novel Evaluation Perspective on GNNs-based Recommender Systems through the Topology of the User-Item Graph
by: Malitesta, Daniele, et al.
Published: (2024)

Know Your Users! Estimating User Domain Knowledge in Conversational Recommenders
by: Kostric, Ivica, et al.
Published: (2025)

Rec-R1: Bridging Generative Large Language Models and User-Centric Recommendation Systems via Reinforcement Learning
by: Lin, Jiacheng, et al.
Published: (2025)

Relevance meets Diversity: A User-Centric Framework for Knowledge Exploration through Recommendations
by: Coppolillo, Erica, et al.
Published: (2024)

Personalized Deep Research: A User-Centric Framework, Dataset, and Hybrid Evaluation for Knowledge Discovery
by: Li, Xiaopeng, et al.
Published: (2026)