Reason4Rec: Large Language Models for Recommendation with Deliberative User Preference Alignment

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Fang, Yi, Wang, Wenjie, Zhang, Yang, Zhu, Fengbin, Wang, Qifan, Feng, Fuli, He, Xiangnan
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916616777760768
author Fang, Yi
Wang, Wenjie
Zhang, Yang
Zhu, Fengbin
Wang, Qifan
Feng, Fuli
He, Xiangnan
author_facet Fang, Yi
Wang, Wenjie
Zhang, Yang
Zhu, Fengbin
Wang, Qifan
Feng, Fuli
He, Xiangnan
contents While recent advancements in aligning Large Language Models (LLMs) with recommendation tasks have shown great potential and promising performance overall, these aligned recommendation LLMs still face challenges in complex scenarios. This is primarily due to the current alignment approach focusing on optimizing LLMs to generate user feedback directly, without incorporating deliberation. To overcome this limitation and develop more reliable LLMs for recommendations, we propose a new Deliberative Recommendation task, which incorporates explicit reasoning about user preferences as an additional alignment goal. We then introduce the Reasoning-powered Recommender framework for deliberative user preference alignment, designed to enhance reasoning capabilities by utilizing verbalized user feedback in a step-wise manner to tackle this task. The framework employs collaborative step-wise experts and tailored training strategies for each expert. Experimental results across three real-world datasets demonstrate the rationality of the deliberative task formulation and the superior performance of the proposed framework in improving both prediction accuracy and reasoning quality.
format Preprint
id arxiv_https___arxiv_org_abs_2502_02061
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Reason4Rec: Large Language Models for Recommendation with Deliberative User Preference Alignment
Fang, Yi
Wang, Wenjie
Zhang, Yang
Zhu, Fengbin
Wang, Qifan
Feng, Fuli
He, Xiangnan
Information Retrieval
While recent advancements in aligning Large Language Models (LLMs) with recommendation tasks have shown great potential and promising performance overall, these aligned recommendation LLMs still face challenges in complex scenarios. This is primarily due to the current alignment approach focusing on optimizing LLMs to generate user feedback directly, without incorporating deliberation. To overcome this limitation and develop more reliable LLMs for recommendations, we propose a new Deliberative Recommendation task, which incorporates explicit reasoning about user preferences as an additional alignment goal. We then introduce the Reasoning-powered Recommender framework for deliberative user preference alignment, designed to enhance reasoning capabilities by utilizing verbalized user feedback in a step-wise manner to tackle this task. The framework employs collaborative step-wise experts and tailored training strategies for each expert. Experimental results across three real-world datasets demonstrate the rationality of the deliberative task formulation and the superior performance of the proposed framework in improving both prediction accuracy and reasoning quality.
title Reason4Rec: Large Language Models for Recommendation with Deliberative User Preference Alignment
topic Information Retrieval
url https://arxiv.org/abs/2502.02061