Evaluating Podcast Recommendations with Profile-Aware LLM-as-a-Judge

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fabbri, Francesco, Penha, Gustavo, D'Amico, Edoardo, Wang, Alice, De Nadai, Marco, Doremus, Jackie, Gigioli, Paul, Damianou, Andreas, Stal, Oskar, Lalmas, Mounia
Format:	Preprint
Published:	2025
Subjects:	Information Retrieval Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Graph Foundation Models for Personalization
by: Damianou, Andreas, et al.
Published: (2024)

Describe What You See with Multimodal Large Language Models to Enhance Video Recommendations
by: De Nadai, Marco, et al.
Published: (2025)

Do LLM-judges Align with Human Relevance in Cranfield-style Recommender Evaluation?
by: Penha, Gustavo, et al.
Published: (2025)

Personalized Audiobook Recommendations at Spotify Through Graph Neural Networks
by: De Nadai, Marco, et al.
Published: (2024)

Text2Tracks: Prompt-based Music Recommendation via Generative Retrieval
by: Palumbo, Enrico, et al.
Published: (2025)

Semantic IDs for Joint Generative Search and Recommendation
by: Penha, Gustavo, et al.
Published: (2025)

Deploying Semantic ID-based Generative Retrieval for Large-Scale Podcast Discovery at Spotify
by: D'Amico, Edoardo, et al.
Published: (2026)

Prompt-to-Slate: Diffusion Models for Prompt-Conditioned Slate Generation
by: Tomasi, Federico, et al.
Published: (2024)

A Unified Language Model for Large Scale Search, Recommendation, and Reasoning
by: De Nadai, Marco, et al.
Published: (2026)

Dataset-Agnostic Recommender Systems
by: Wijaya, Tri Kurniawan, et al.
Published: (2025)

Bridging Search and Recommendation in Generative Retrieval: Does One Task Help the Other?
by: Penha, Gustavo, et al.
Published: (2024)

RBoard: A Unified Platform for Reproducible and Reusable Recommender System Benchmarks
by: Shao, Xinyang, et al.
Published: (2024)

Rs4rs: Semantically Find Recent Publications from Top Recommendation System-Related Venues
by: Wijaya, Tri Kurniawan, et al.
Published: (2024)

PODTILE: Facilitating Podcast Episode Browsing with Auto-generated Chapters
by: Ghazimatin, Azin, et al.
Published: (2024)

Universal Reusability in Recommender Systems: The Case for Dataset- and Task-Independent Frameworks
by: Wijaya, Tri Kurniawan, et al.
Published: (2025)

Calibrated Recommendations with Contextual Bandits
by: Feijer, Diego, et al.
Published: (2025)

Generating Query Recommendations via LLMs
by: Bacciu, Andrea, et al.
Published: (2024)

Generalized User Representations for Transfer Learning
by: Fazelnia, Ghazal, et al.
Published: (2024)

Efficient Dataset Selection for Continual Adaptation of Generative Recommenders
by: Jiao, Cathy, et al.
Published: (2026)

Aligned Query Expansion: Efficient Query Expansion for Information Retrieval through LLM Alignment
by: Yang, Adam, et al.
Published: (2025)

GNNUERS: Fairness Explanation in GNNs for Recommendation via Counterfactual Reasoning
by: Medda, Giacomo, et al.
Published: (2023)

Robustness in Fairness against Edge-level Perturbations in GNN-based Recommendation
by: Boratto, Ludovico, et al.
Published: (2024)

Contextualizing Spotify's Audiobook List Recommendations with Descriptive Shelves
by: Penha, Gustavo, et al.
Published: (2025)

Function-based Labels for Complementary Recommendation: Definition, Annotation, and LLM-as-a-Judge
by: Yamasaki, Chihiro, et al.
Published: (2025)

Biases in LLM-Generated Musical Taste Profiles for Recommendation
by: Sguerra, Bruno, et al.
Published: (2025)

Revisiting Human-vs-LLM judgments using the TREC Podcast Track
by: Mansour, Watheq, et al.
Published: (2026)

Beyond Relevance: An Adaptive Exploration-Based Framework for Personalized Recommendations
by: Bianchi, Edoardo
Published: (2025)

LLM-as-a-Judge: Toward World Models for Slate Recommendation Systems
by: Bonin, Baptiste, et al.
Published: (2025)

Policy-as-Prompt: Rethinking Content Moderation in the Age of Large Language Models
by: Palla, Konstantina, et al.
Published: (2025)

Judging the Judges: A Collection of LLM-Generated Relevance Judgements
by: Rahmani, Hossein A., et al.
Published: (2025)

From Hidden Profiles to Governable Personalization: Recommender Systems in the Age of LLM Agents
by: Liu, Jiahao, et al.
Published: (2026)

Uncertainty-Aware Semantic Decoding for LLM-Based Sequential Recommendation
by: Yin, Chenke, et al.
Published: (2025)

ProMax: Exploring the Potential of LLM-derived Profiles with Distribution Shaping for Recommender Systems
by: Zhang, Yi, et al.
Published: (2026)

Diagnostic-Guided Dynamic Profile Optimization for LLM-based User Simulators in Sequential Recommendation
by: Liu, Hongyang, et al.
Published: (2025)

Task-Aware Automated User Profile Generation for Recommendation Simulation Using Large Language Models
by: Wanyan, Xinye, et al.
Published: (2026)

Embedding-to-Prefix: Parameter-Efficient Personalization for Pre-Trained Large Language Models
by: Huber, Bernd, et al.
Published: (2025)

Transforming Podcast Preview Generation: From Expert Models to LLM-Based Systems
by: Zhu, Winstead, et al.
Published: (2025)

HSUGA: LLM-Enhanced Recommendation with Hierarchical Semantic Understanding and Group-Aware Alignment
by: Li, Guorui, et al.
Published: (2026)

Offline Reasoning for Efficient Recommendation: LLM-Empowered Persona-Profiled Item Indexing
by: Kim, Deogyong, et al.
Published: (2026)

Algorithmic Drift: A Simulation Framework to Study the Effects of Recommender Systems on User Preferences
by: Coppolillo, Erica, et al.
Published: (2024)