Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Luo, Sichun, Yao, Yuxuan, He, Bowei, Shao, Wei, Xu, Jian, Huang, Yinya, Zhou, Aojun, Zhang, Xinyi, Xiao, Yuanzhang, Hou, Hanxu, Zhan, Mingjie, Song, Linqi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915737104285696
author Luo, Sichun
Yao, Yuxuan
He, Bowei
Shao, Wei
Xu, Jian
Huang, Yinya
Zhou, Aojun
Zhang, Xinyi
Xiao, Yuanzhang
Hou, Hanxu
Zhan, Mingjie
Song, Linqi
author_facet Luo, Sichun
Yao, Yuxuan
He, Bowei
Shao, Wei
Xu, Jian
Huang, Yinya
Zhou, Aojun
Zhang, Xinyi
Xiao, Yuanzhang
Hou, Hanxu
Zhan, Mingjie
Song, Linqi
contents Conventional recommendation methods have achieved notable advancements by harnessing collaborative or sequential information from user behavior. Recently, large language models (LLMs) have gained prominence for their capabilities in understanding and reasoning over textual semantics, and have found utility in various domains, including recommendation. Conventional recommendation methods and LLMs each have their strengths and weaknesses. While conventional methods excel at mining collaborative information and modeling sequential behavior, they struggle with data sparsity and the long-tail problem. LLMs, on the other hand, are proficient at utilizing rich textual contexts but face challenges in mining collaborative or sequential information. Despite their individual successes, there is a significant gap in leveraging their combined potential to enhance recommendation performance. In this paper, we introduce a general and model-agnostic framework known as \textbf{L}arge \textbf{la}nguage model with \textbf{m}utual augmentation and \textbf{a}daptive aggregation for \textbf{Rec}ommendation (\textbf{Llama4Rec}). Llama4Rec synergistically combines conventional and LLM-based recommendation models. Llama4Rec proposes data augmentation and prompt augmentation strategies tailored to enhance the conventional model and LLM respectively. An adaptive aggregation module is adopted to combine the predictions of both kinds of models to refine the final recommendation results. Empirical studies on three real-world datasets validate the superiority of Llama4Rec, demonstrating its consistent outperformance of baseline methods and significant improvements in recommendation performance.
format Preprint
id arxiv_https___arxiv_org_abs_2401_13870
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregation
Luo, Sichun
Yao, Yuxuan
He, Bowei
Shao, Wei
Xu, Jian
Huang, Yinya
Zhou, Aojun
Zhang, Xinyi
Xiao, Yuanzhang
Hou, Hanxu
Zhan, Mingjie
Song, Linqi
Information Retrieval
Conventional recommendation methods have achieved notable advancements by harnessing collaborative or sequential information from user behavior. Recently, large language models (LLMs) have gained prominence for their capabilities in understanding and reasoning over textual semantics, and have found utility in various domains, including recommendation. Conventional recommendation methods and LLMs each have their strengths and weaknesses. While conventional methods excel at mining collaborative information and modeling sequential behavior, they struggle with data sparsity and the long-tail problem. LLMs, on the other hand, are proficient at utilizing rich textual contexts but face challenges in mining collaborative or sequential information. Despite their individual successes, there is a significant gap in leveraging their combined potential to enhance recommendation performance. In this paper, we introduce a general and model-agnostic framework known as \textbf{L}arge \textbf{la}nguage model with \textbf{m}utual augmentation and \textbf{a}daptive aggregation for \textbf{Rec}ommendation (\textbf{Llama4Rec}). Llama4Rec synergistically combines conventional and LLM-based recommendation models. Llama4Rec proposes data augmentation and prompt augmentation strategies tailored to enhance the conventional model and LLM respectively. An adaptive aggregation module is adopted to combine the predictions of both kinds of models to refine the final recommendation results. Empirical studies on three real-world datasets validate the superiority of Llama4Rec, demonstrating its consistent outperformance of baseline methods and significant improvements in recommendation performance.
title Integrating Large Language Models into Recommendation via Mutual Augmentation and Adaptive Aggregation
topic Information Retrieval
url https://arxiv.org/abs/2401.13870