Saved in:
Bibliographic Details
Main Authors: Zhang, Le, Wang, Bo, Qiu, Xipeng, Reddy, Siva, Agrawal, Aishwarya
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.20046
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909623472095232
author Zhang, Le
Wang, Bo
Qiu, Xipeng
Reddy, Siva
Agrawal, Aishwarya
author_facet Zhang, Le
Wang, Bo
Qiu, Xipeng
Reddy, Siva
Agrawal, Aishwarya
contents We present REARANK, a large language model (LLM)-based listwise reasoning reranking agent. REARANK explicitly reasons before reranking, significantly improving both performance and interpretability. Leveraging reinforcement learning and data augmentation, REARANK achieves substantial improvements over baseline models across popular information retrieval benchmarks, notably requiring only 179 annotated samples. Built on top of Qwen2.5-7B, our REARANK-7B demonstrates performance comparable to GPT-4 on both in-domain and out-of-domain benchmarks and even surpasses GPT-4 on reasoning-intensive BRIGHT benchmarks. These results underscore the effectiveness of our approach and highlight how reinforcement learning can enhance LLM reasoning capabilities in reranking.
format Preprint
id arxiv_https___arxiv_org_abs_2505_20046
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle REARANK: Reasoning Re-ranking Agent via Reinforcement Learning
Zhang, Le
Wang, Bo
Qiu, Xipeng
Reddy, Siva
Agrawal, Aishwarya
Information Retrieval
Computation and Language
We present REARANK, a large language model (LLM)-based listwise reasoning reranking agent. REARANK explicitly reasons before reranking, significantly improving both performance and interpretability. Leveraging reinforcement learning and data augmentation, REARANK achieves substantial improvements over baseline models across popular information retrieval benchmarks, notably requiring only 179 annotated samples. Built on top of Qwen2.5-7B, our REARANK-7B demonstrates performance comparable to GPT-4 on both in-domain and out-of-domain benchmarks and even surpasses GPT-4 on reasoning-intensive BRIGHT benchmarks. These results underscore the effectiveness of our approach and highlight how reinforcement learning can enhance LLM reasoning capabilities in reranking.
title REARANK: Reasoning Re-ranking Agent via Reinforcement Learning
topic Information Retrieval
Computation and Language
url https://arxiv.org/abs/2505.20046