Improving the Performance of Sequential Recommendation Systems with an Extended Large Language Model

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Choi, Sinnyum, Kim, Woong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909706928259072
author Choi, Sinnyum
Kim, Woong
author_facet Choi, Sinnyum
Kim, Woong
contents Recently, competition in the field of artificial intelligence (AI) has intensified among major technological companies, resulting in the continuous release of new large-language models (LLMs) that exhibit improved language understanding and context-based reasoning capabilities. It is expected that these advances will enable more efficient personalized recommendations in LLM-based recommendation systems through improved quality of training data and architectural design. However, many studies have not considered these recent developments. In this study, it was proposed to improve LLM-based recommendation systems by replacing Llama2 with Llama3 in the LlamaRec framework. To ensure a fair comparison, random seed values were set and identical input data was provided during preprocessing and training. The experimental results show average performance improvements of 38.65\%, 8.69\%, and 8.19\% for the ML-100K, Beauty, and Games datasets, respectively, thus confirming the practicality of this method. Notably, the significant improvements achieved by model replacement indicate that the recommendation quality can be improved cost-effectively without the need to make structural changes to the system. Based on these results, it is our contention that the proposed approach is a viable solution for improving the performance of current recommendation systems.
format Preprint
id arxiv_https___arxiv_org_abs_2507_19990
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Improving the Performance of Sequential Recommendation Systems with an Extended Large Language Model
Choi, Sinnyum
Kim, Woong
Information Retrieval
Artificial Intelligence
Computation and Language
H.3.3; I.2.6; I.2.7
Recently, competition in the field of artificial intelligence (AI) has intensified among major technological companies, resulting in the continuous release of new large-language models (LLMs) that exhibit improved language understanding and context-based reasoning capabilities. It is expected that these advances will enable more efficient personalized recommendations in LLM-based recommendation systems through improved quality of training data and architectural design. However, many studies have not considered these recent developments. In this study, it was proposed to improve LLM-based recommendation systems by replacing Llama2 with Llama3 in the LlamaRec framework. To ensure a fair comparison, random seed values were set and identical input data was provided during preprocessing and training. The experimental results show average performance improvements of 38.65\%, 8.69\%, and 8.19\% for the ML-100K, Beauty, and Games datasets, respectively, thus confirming the practicality of this method. Notably, the significant improvements achieved by model replacement indicate that the recommendation quality can be improved cost-effectively without the need to make structural changes to the system. Based on these results, it is our contention that the proposed approach is a viable solution for improving the performance of current recommendation systems.
title Improving the Performance of Sequential Recommendation Systems with an Extended Large Language Model
topic Information Retrieval
Artificial Intelligence
Computation and Language
H.3.3; I.2.6; I.2.7
url https://arxiv.org/abs/2507.19990