LLM-Powered User Simulator for Recommender System

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Zijian, Liu, Shuchang, Liu, Ziru, Zhong, Rui, Cai, Qingpeng, Zhao, Xiangyu, Zhang, Chunxu, Liu, Qidong, Jiang, Peng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916538572865536
author Zhang, Zijian
Liu, Shuchang
Liu, Ziru
Zhong, Rui
Cai, Qingpeng
Zhao, Xiangyu
Zhang, Chunxu
Liu, Qidong
Jiang, Peng
author_facet Zhang, Zijian
Liu, Shuchang
Liu, Ziru
Zhong, Rui
Cai, Qingpeng
Zhao, Xiangyu
Zhang, Chunxu
Liu, Qidong
Jiang, Peng
contents User simulators can rapidly generate a large volume of timely user behavior data, providing a testing platform for reinforcement learning-based recommender systems, thus accelerating their iteration and optimization. However, prevalent user simulators generally suffer from significant limitations, including the opacity of user preference modeling and the incapability of evaluating simulation accuracy. In this paper, we introduce an LLM-powered user simulator to simulate user engagement with items in an explicit manner, thereby enhancing the efficiency and effectiveness of reinforcement learning-based recommender systems training. Specifically, we identify the explicit logic of user preferences, leverage LLMs to analyze item characteristics and distill user sentiments, and design a logical model to imitate real human engagement. By integrating a statistical model, we further enhance the reliability of the simulation, proposing an ensemble model that synergizes logical and statistical insights for user interaction simulations. Capitalizing on the extensive knowledge and semantic generation capabilities of LLMs, our user simulator faithfully emulates user behaviors and preferences, yielding high-fidelity training data that enrich the training of recommendation algorithms. We establish quantifying and qualifying experiments on five datasets to validate the simulator's effectiveness and stability across various recommendation scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2412_16984
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle LLM-Powered User Simulator for Recommender System
Zhang, Zijian
Liu, Shuchang
Liu, Ziru
Zhong, Rui
Cai, Qingpeng
Zhao, Xiangyu
Zhang, Chunxu
Liu, Qidong
Jiang, Peng
Information Retrieval
Artificial Intelligence
User simulators can rapidly generate a large volume of timely user behavior data, providing a testing platform for reinforcement learning-based recommender systems, thus accelerating their iteration and optimization. However, prevalent user simulators generally suffer from significant limitations, including the opacity of user preference modeling and the incapability of evaluating simulation accuracy. In this paper, we introduce an LLM-powered user simulator to simulate user engagement with items in an explicit manner, thereby enhancing the efficiency and effectiveness of reinforcement learning-based recommender systems training. Specifically, we identify the explicit logic of user preferences, leverage LLMs to analyze item characteristics and distill user sentiments, and design a logical model to imitate real human engagement. By integrating a statistical model, we further enhance the reliability of the simulation, proposing an ensemble model that synergizes logical and statistical insights for user interaction simulations. Capitalizing on the extensive knowledge and semantic generation capabilities of LLMs, our user simulator faithfully emulates user behaviors and preferences, yielding high-fidelity training data that enrich the training of recommendation algorithms. We establish quantifying and qualifying experiments on five datasets to validate the simulator's effectiveness and stability across various recommendation scenarios.
title LLM-Powered User Simulator for Recommender System
topic Information Retrieval
Artificial Intelligence
url https://arxiv.org/abs/2412.16984