Agentic Feedback Loop Modeling Improves Recommendation and User Simulation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cai, Shihao, Zhang, Jizhi, Bao, Keqin, Gao, Chongming, Wang, Qifan, Feng, Fuli, He, Xiangnan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908345098567680
author Cai, Shihao
Zhang, Jizhi
Bao, Keqin
Gao, Chongming
Wang, Qifan
Feng, Fuli
He, Xiangnan
author_facet Cai, Shihao
Zhang, Jizhi
Bao, Keqin
Gao, Chongming
Wang, Qifan
Feng, Fuli
He, Xiangnan
contents Large language model-based agents are increasingly applied in the recommendation field due to their extensive knowledge and strong planning capabilities. While prior research has primarily focused on enhancing either the recommendation agent or the user agent individually, the collaborative interaction between the two has often been overlooked. Towards this research gap, we propose a novel framework that emphasizes the feedback loop process to facilitate the collaboration between the recommendation agent and the user agent. Specifically, the recommendation agent refines its understanding of user preferences by analyzing the feedback from the user agent on the item recommendation. Conversely, the user agent further identifies potential user interests based on the items and recommendation reasons provided by the recommendation agent. This iterative process enhances the ability of both agents to infer user behaviors, enabling more effective item recommendations and more accurate user simulations. Extensive experiments on three datasets demonstrate the effectiveness of the agentic feedback loop: the agentic feedback loop yields an average improvement of 11.52% over the single recommendation agent and 21.12% over the single user agent. Furthermore, the results show that the agentic feedback loop does not exacerbate popularity or position bias, which are typically amplified by the real-world feedback loop, highlighting its robustness. The source code is available at https://github.com/Lanyu0303/AFL.
format Preprint
id arxiv_https___arxiv_org_abs_2410_20027
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Agentic Feedback Loop Modeling Improves Recommendation and User Simulation
Cai, Shihao
Zhang, Jizhi
Bao, Keqin
Gao, Chongming
Wang, Qifan
Feng, Fuli
He, Xiangnan
Information Retrieval
Artificial Intelligence
Large language model-based agents are increasingly applied in the recommendation field due to their extensive knowledge and strong planning capabilities. While prior research has primarily focused on enhancing either the recommendation agent or the user agent individually, the collaborative interaction between the two has often been overlooked. Towards this research gap, we propose a novel framework that emphasizes the feedback loop process to facilitate the collaboration between the recommendation agent and the user agent. Specifically, the recommendation agent refines its understanding of user preferences by analyzing the feedback from the user agent on the item recommendation. Conversely, the user agent further identifies potential user interests based on the items and recommendation reasons provided by the recommendation agent. This iterative process enhances the ability of both agents to infer user behaviors, enabling more effective item recommendations and more accurate user simulations. Extensive experiments on three datasets demonstrate the effectiveness of the agentic feedback loop: the agentic feedback loop yields an average improvement of 11.52% over the single recommendation agent and 21.12% over the single user agent. Furthermore, the results show that the agentic feedback loop does not exacerbate popularity or position bias, which are typically amplified by the real-world feedback loop, highlighting its robustness. The source code is available at https://github.com/Lanyu0303/AFL.
title Agentic Feedback Loop Modeling Improves Recommendation and User Simulation
topic Information Retrieval
Artificial Intelligence
url https://arxiv.org/abs/2410.20027