Verifiable Reasoning for LLM-based Generative Recommendation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lin, Xinyu, Zeng, Hanqing, Yu, Hanchao, Xia, Yinglong, Zhang, Jiang, Singh, Aashu, Liu, Fei, Wang, Wenjie, Feng, Fuli, Chua, Tat-Seng, Wang, Qifan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915845225054208
author Lin, Xinyu
Zeng, Hanqing
Yu, Hanchao
Xia, Yinglong
Zhang, Jiang
Singh, Aashu
Liu, Fei
Wang, Wenjie
Feng, Fuli
Chua, Tat-Seng
Wang, Qifan
author_facet Lin, Xinyu
Zeng, Hanqing
Yu, Hanchao
Xia, Yinglong
Zhang, Jiang
Singh, Aashu
Liu, Fei
Wang, Wenjie
Feng, Fuli
Chua, Tat-Seng
Wang, Qifan
contents Reasoning in Large Language Models (LLMs) has recently shown strong potential in enhancing generative recommendation through deep understanding of complex user preference. Existing approaches follow a {reason-then-recommend} paradigm, where LLMs perform step-by-step reasoning before item generation. However, this paradigm inevitably suffers from reasoning degradation (i.e., homogeneous or error-accumulated reasoning) due to the lack of intermediate verification, thus undermining the recommendation. To bridge this gap, we propose a novel \textbf{\textit{reason-verify-recommend}} paradigm, which interleaves reasoning with verification to provide reliable feedback, guiding the reasoning process toward more faithful user preference understanding. To enable effective verification, we establish two key principles for verifier design: 1) reliability ensures accurate evaluation of reasoning correctness and informative guidance generation; and 2) multi-dimensionality emphasizes comprehensive verification across multi-dimensional user preferences. Accordingly, we propose an effective implementation called VRec. It employs a mixture of verifiers to ensure multi-dimensionality, while leveraging a proxy prediction objective to pursue reliability. Experiments on four real-world datasets demonstrate that VRec substantially enhances recommendation effectiveness and scalability without compromising efficiency. The codes can be found at https://github.com/Linxyhaha/Verifiable-Rec.
format Preprint
id arxiv_https___arxiv_org_abs_2603_07725
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Verifiable Reasoning for LLM-based Generative Recommendation
Lin, Xinyu
Zeng, Hanqing
Yu, Hanchao
Xia, Yinglong
Zhang, Jiang
Singh, Aashu
Liu, Fei
Wang, Wenjie
Feng, Fuli
Chua, Tat-Seng
Wang, Qifan
Information Retrieval
Reasoning in Large Language Models (LLMs) has recently shown strong potential in enhancing generative recommendation through deep understanding of complex user preference. Existing approaches follow a {reason-then-recommend} paradigm, where LLMs perform step-by-step reasoning before item generation. However, this paradigm inevitably suffers from reasoning degradation (i.e., homogeneous or error-accumulated reasoning) due to the lack of intermediate verification, thus undermining the recommendation. To bridge this gap, we propose a novel \textbf{\textit{reason-verify-recommend}} paradigm, which interleaves reasoning with verification to provide reliable feedback, guiding the reasoning process toward more faithful user preference understanding. To enable effective verification, we establish two key principles for verifier design: 1) reliability ensures accurate evaluation of reasoning correctness and informative guidance generation; and 2) multi-dimensionality emphasizes comprehensive verification across multi-dimensional user preferences. Accordingly, we propose an effective implementation called VRec. It employs a mixture of verifiers to ensure multi-dimensionality, while leveraging a proxy prediction objective to pursue reliability. Experiments on four real-world datasets demonstrate that VRec substantially enhances recommendation effectiveness and scalability without compromising efficiency. The codes can be found at https://github.com/Linxyhaha/Verifiable-Rec.
title Verifiable Reasoning for LLM-based Generative Recommendation
topic Information Retrieval
url https://arxiv.org/abs/2603.07725