Reindex-Then-Adapt: Improving Large Language Models for Conversational Recommendation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: He, Zhankui, Xie, Zhouhang, Steck, Harald, Liang, Dawen, Jha, Rahul, Kallus, Nathan, McAuley, Julian
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914803113525248
author He, Zhankui
Xie, Zhouhang
Steck, Harald
Liang, Dawen
Jha, Rahul
Kallus, Nathan
McAuley, Julian
author_facet He, Zhankui
Xie, Zhouhang
Steck, Harald
Liang, Dawen
Jha, Rahul
Kallus, Nathan
McAuley, Julian
contents Large language models (LLMs) are revolutionizing conversational recommender systems by adeptly indexing item content, understanding complex conversational contexts, and generating relevant item titles. However, controlling the distribution of recommended items remains a challenge. This leads to suboptimal performance due to the failure to capture rapidly changing data distributions, such as item popularity, on targeted conversational recommendation platforms. In conversational recommendation, LLMs recommend items by generating the titles (as multiple tokens) autoregressively, making it difficult to obtain and control the recommendations over all items. Thus, we propose a Reindex-Then-Adapt (RTA) framework, which converts multi-token item titles into single tokens within LLMs, and then adjusts the probability distributions over these single-token item titles accordingly. The RTA framework marries the benefits of both LLMs and traditional recommender systems (RecSys): understanding complex queries as LLMs do; while efficiently controlling the recommended item distributions in conversational recommendations as traditional RecSys do. Our framework demonstrates improved accuracy metrics across three different conversational recommendation datasets and two adaptation settings
format Preprint
id arxiv_https___arxiv_org_abs_2405_12119
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Reindex-Then-Adapt: Improving Large Language Models for Conversational Recommendation
He, Zhankui
Xie, Zhouhang
Steck, Harald
Liang, Dawen
Jha, Rahul
Kallus, Nathan
McAuley, Julian
Information Retrieval
Artificial Intelligence
Computation and Language
Large language models (LLMs) are revolutionizing conversational recommender systems by adeptly indexing item content, understanding complex conversational contexts, and generating relevant item titles. However, controlling the distribution of recommended items remains a challenge. This leads to suboptimal performance due to the failure to capture rapidly changing data distributions, such as item popularity, on targeted conversational recommendation platforms. In conversational recommendation, LLMs recommend items by generating the titles (as multiple tokens) autoregressively, making it difficult to obtain and control the recommendations over all items. Thus, we propose a Reindex-Then-Adapt (RTA) framework, which converts multi-token item titles into single tokens within LLMs, and then adjusts the probability distributions over these single-token item titles accordingly. The RTA framework marries the benefits of both LLMs and traditional recommender systems (RecSys): understanding complex queries as LLMs do; while efficiently controlling the recommended item distributions in conversational recommendations as traditional RecSys do. Our framework demonstrates improved accuracy metrics across three different conversational recommendation datasets and two adaptation settings
title Reindex-Then-Adapt: Improving Large Language Models for Conversational Recommendation
topic Information Retrieval
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2405.12119