Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zheng, Kehan, Hong, Deyao, Li, Qian, Zhang, Jun, Yu, Huan, Jiang, Jie, Wang, Hongning
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910021055414272
author Zheng, Kehan
Hong, Deyao
Li, Qian
Zhang, Jun
Yu, Huan
Jiang, Jie
Wang, Hongning
author_facet Zheng, Kehan
Hong, Deyao
Li, Qian
Zhang, Jun
Yu, Huan
Jiang, Jie
Wang, Hongning
contents Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs) for recommendation, but how to effectively optimize the model for improved recommendation utility is still under explored. In this work, we propose Reasoning to Rank, an end-to-end training framework that internalizes recommendation utility optimization into the learning of step-by-step reasoning in LLMs. To avoid position bias in LLM reasoning and enable direct optimization of the reasoning process, our framework performs reasoning at the user-item level and employs reinforcement learning for end-to-end training of the LLM. Experiments on three Amazon datasets and a large-scale industrial dataset showed consistent gains over strong conventional and LLM-based solutions. Extensive in-depth analyses validate the necessity of the key components in the proposed framework and shed lights on the future developments of this line of work.
format Preprint
id arxiv_https___arxiv_org_abs_2602_12530
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendation
Zheng, Kehan
Hong, Deyao
Li, Qian
Zhang, Jun
Yu, Huan
Jiang, Jie
Wang, Hongning
Information Retrieval
Recommender systems are tasked to infer users' evolving preferences and rank items aligned with their intents, which calls for in-depth reasoning beyond pattern-based scoring. Recent efforts start to leverage large language models (LLMs) for recommendation, but how to effectively optimize the model for improved recommendation utility is still under explored. In this work, we propose Reasoning to Rank, an end-to-end training framework that internalizes recommendation utility optimization into the learning of step-by-step reasoning in LLMs. To avoid position bias in LLM reasoning and enable direct optimization of the reasoning process, our framework performs reasoning at the user-item level and employs reinforcement learning for end-to-end training of the LLM. Experiments on three Amazon datasets and a large-scale industrial dataset showed consistent gains over strong conventional and LLM-based solutions. Extensive in-depth analyses validate the necessity of the key components in the proposed framework and shed lights on the future developments of this line of work.
title Reasoning to Rank: An End-to-End Solution for Exploiting Large Language Models for Recommendation
topic Information Retrieval
url https://arxiv.org/abs/2602.12530