Improving Sequential Recommendations with LLMs

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Boz, Artun, Zorgdrager, Wouter, Kotti, Zoe, Harte, Jesse, Louridas, Panos, Jannach, Dietmar, Karakoidas, Vassilios, Fragkoulis, Marios
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913643846696960
author Boz, Artun
Zorgdrager, Wouter
Kotti, Zoe
Harte, Jesse
Louridas, Panos
Jannach, Dietmar
Karakoidas, Vassilios
Fragkoulis, Marios
author_facet Boz, Artun
Zorgdrager, Wouter
Kotti, Zoe
Harte, Jesse
Louridas, Panos
Jannach, Dietmar
Karakoidas, Vassilios
Fragkoulis, Marios
contents The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays introducing disruptive effects in many AI-based applications, can be used to build or improve sequential recommendation approaches. Specifically, we design three orthogonal approaches and hybrids of those to leverage the power of LLMs in different ways. In addition, we investigate the potential of each approach by focusing on its comprising technical aspects and determining an array of alternative choices for each one. We conduct extensive experiments on three datasets and explore a large variety of configurations, including different language models and baseline recommendation models, to obtain a comprehensive picture of the performance of each approach. Among other observations, we highlight that initializing state-of-the-art sequential recommendation models such as BERT4Rec or SASRec with embeddings obtained from an LLM can lead to substantial performance gains in terms of accuracy. Furthermore, we find that fine-tuning an LLM for recommendation tasks enables it to learn not only the tasks, but also concepts of a domain to some extent. We also show that fine-tuning OpenAI GPT leads to considerably better performance than fine-tuning Google PaLM 2. Overall, our extensive experiments indicate a huge potential value of leveraging LLMs in future recommendation approaches. We publicly share the code and data of our experiments to ensure reproducibility.
format Preprint
id arxiv_https___arxiv_org_abs_2402_01339
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Improving Sequential Recommendations with LLMs
Boz, Artun
Zorgdrager, Wouter
Kotti, Zoe
Harte, Jesse
Louridas, Panos
Jannach, Dietmar
Karakoidas, Vassilios
Fragkoulis, Marios
Information Retrieval
The sequential recommendation problem has attracted considerable research attention in the past few years, leading to the rise of numerous recommendation models. In this work, we explore how Large Language Models (LLMs), which are nowadays introducing disruptive effects in many AI-based applications, can be used to build or improve sequential recommendation approaches. Specifically, we design three orthogonal approaches and hybrids of those to leverage the power of LLMs in different ways. In addition, we investigate the potential of each approach by focusing on its comprising technical aspects and determining an array of alternative choices for each one. We conduct extensive experiments on three datasets and explore a large variety of configurations, including different language models and baseline recommendation models, to obtain a comprehensive picture of the performance of each approach. Among other observations, we highlight that initializing state-of-the-art sequential recommendation models such as BERT4Rec or SASRec with embeddings obtained from an LLM can lead to substantial performance gains in terms of accuracy. Furthermore, we find that fine-tuning an LLM for recommendation tasks enables it to learn not only the tasks, but also concepts of a domain to some extent. We also show that fine-tuning OpenAI GPT leads to considerably better performance than fine-tuning Google PaLM 2. Overall, our extensive experiments indicate a huge potential value of leveraging LLMs in future recommendation approaches. We publicly share the code and data of our experiments to ensure reproducibility.
title Improving Sequential Recommendations with LLMs
topic Information Retrieval
url https://arxiv.org/abs/2402.01339