Preference Discerning with LLM-Enhanced Generative Retrieval

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Paischer, Fabian, Yang, Liu, Liu, Linfeng, Shao, Shuai, Hassani, Kaveh, Li, Jiacheng, Chen, Ricky, Li, Zhang Gabriel, Gao, Xiaoli, Shao, Wei, Feng, Xue, Noorshams, Nima, Park, Sem, Long, Bo, Eghbalzadeh, Hamid
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912640671940608
author Paischer, Fabian
Yang, Liu
Liu, Linfeng
Shao, Shuai
Hassani, Kaveh
Li, Jiacheng
Chen, Ricky
Li, Zhang Gabriel
Gao, Xiaoli
Shao, Wei
Feng, Xue
Noorshams, Nima
Park, Sem
Long, Bo
Eghbalzadeh, Hamid
author_facet Paischer, Fabian
Yang, Liu
Liu, Linfeng
Shao, Shuai
Hassani, Kaveh
Li, Jiacheng
Chen, Ricky
Li, Zhang Gabriel
Gao, Xiaoli
Shao, Wei
Feng, Xue
Noorshams, Nima
Park, Sem
Long, Bo
Eghbalzadeh, Hamid
contents In sequential recommendation, models recommend items based on user's interaction history. To this end, current models usually incorporate information such as item descriptions and user intent or preferences. User preferences are usually not explicitly given in open-source datasets, and thus need to be approximated, for example via large language models (LLMs). Current approaches leverage approximated user preferences only during training and rely solely on the past interaction history for recommendations, limiting their ability to dynamically adapt to changing preferences, potentially reinforcing echo chambers. To address this issue, we propose a new paradigm, namely preference discerning, which explicitly conditions a generative recommendation model on user preferences in natural language within its context. To evaluate preference discerning, we introduce a novel benchmark that provides a holistic evaluation across various scenarios, including preference steering and sentiment following. Upon evaluating current state-of-the-art methods on our benchmark, we discover that their ability to dynamically adapt to evolving user preferences is limited. To address this, we propose a new method named Mender ($\textbf{M}$ultimodal Prefer$\textbf{en}$ce $\textbf{D}$iscern$\textbf{er}$), which achieves state-of-the-art performance in our benchmark. Our results show that Mender effectively adapts its recommendation guided by human preferences, even if not observed during training, paving the way toward more flexible recommendation models.
format Preprint
id arxiv_https___arxiv_org_abs_2412_08604
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Preference Discerning with LLM-Enhanced Generative Retrieval
Paischer, Fabian
Yang, Liu
Liu, Linfeng
Shao, Shuai
Hassani, Kaveh
Li, Jiacheng
Chen, Ricky
Li, Zhang Gabriel
Gao, Xiaoli
Shao, Wei
Feng, Xue
Noorshams, Nima
Park, Sem
Long, Bo
Eghbalzadeh, Hamid
Information Retrieval
Artificial Intelligence
Machine Learning
In sequential recommendation, models recommend items based on user's interaction history. To this end, current models usually incorporate information such as item descriptions and user intent or preferences. User preferences are usually not explicitly given in open-source datasets, and thus need to be approximated, for example via large language models (LLMs). Current approaches leverage approximated user preferences only during training and rely solely on the past interaction history for recommendations, limiting their ability to dynamically adapt to changing preferences, potentially reinforcing echo chambers. To address this issue, we propose a new paradigm, namely preference discerning, which explicitly conditions a generative recommendation model on user preferences in natural language within its context. To evaluate preference discerning, we introduce a novel benchmark that provides a holistic evaluation across various scenarios, including preference steering and sentiment following. Upon evaluating current state-of-the-art methods on our benchmark, we discover that their ability to dynamically adapt to evolving user preferences is limited. To address this, we propose a new method named Mender ($\textbf{M}$ultimodal Prefer$\textbf{en}$ce $\textbf{D}$iscern$\textbf{er}$), which achieves state-of-the-art performance in our benchmark. Our results show that Mender effectively adapts its recommendation guided by human preferences, even if not observed during training, paving the way toward more flexible recommendation models.
title Preference Discerning with LLM-Enhanced Generative Retrieval
topic Information Retrieval
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2412.08604