SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generated LLMs

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Haotian, Long, Qingqing, Xiao, Meng, Luo, Xiao, Ju, Wei, Wang, Chengrui, Wang, Xuezhi, Zhou, Yuanchun, Zhu, Hengshu
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909803776835584
author Chen, Haotian
Long, Qingqing
Xiao, Meng
Luo, Xiao
Ju, Wei
Wang, Chengrui
Wang, Xuezhi
Zhou, Yuanchun
Zhu, Hengshu
author_facet Chen, Haotian
Long, Qingqing
Xiao, Meng
Luo, Xiao
Ju, Wei
Wang, Chengrui
Wang, Xuezhi
Zhou, Yuanchun
Zhu, Hengshu
contents Scientific literature question answering is a pivotal step towards new scientific discoveries. Recently, \textit{two-stage} retrieval-augmented generated large language models (RAG-LLMs) have shown impressive advancements in this domain. Such a two-stage framework, especially the second stage (reranker), is particularly essential in the scientific domain, where subtle differences in terminology may have a greatly negative impact on the final factual-oriented or knowledge-intensive answers. Despite this significant progress, the potential and limitations of these works remain unexplored. In this work, we present a Scientific Rerank-oriented RAG Benchmark (SciRerankBench), for evaluating rerankers within RAG-LLMs systems, spanning five scientific subjects. To rigorously assess the reranker performance in terms of noise resilience, relevance disambiguation, and factual consistency, we develop three types of question-context-answer (Q-C-A) pairs, i.e., Noisy Contexts (NC), Semantically Similar but Logically Irrelevant Contexts (SSLI), and Counterfactual Contexts (CC). Through systematic evaluation of 13 widely used rerankers on five families of LLMs, we provide detailed insights into their relative strengths and limitations. To the best of our knowledge, SciRerankBench is the first benchmark specifically developed to evaluate rerankers within RAG-LLMs, which provides valuable observations and guidance for their future development.
format Preprint
id arxiv_https___arxiv_org_abs_2508_08742
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generated LLMs
Chen, Haotian
Long, Qingqing
Xiao, Meng
Luo, Xiao
Ju, Wei
Wang, Chengrui
Wang, Xuezhi
Zhou, Yuanchun
Zhu, Hengshu
Computation and Language
Artificial Intelligence
Scientific literature question answering is a pivotal step towards new scientific discoveries. Recently, \textit{two-stage} retrieval-augmented generated large language models (RAG-LLMs) have shown impressive advancements in this domain. Such a two-stage framework, especially the second stage (reranker), is particularly essential in the scientific domain, where subtle differences in terminology may have a greatly negative impact on the final factual-oriented or knowledge-intensive answers. Despite this significant progress, the potential and limitations of these works remain unexplored. In this work, we present a Scientific Rerank-oriented RAG Benchmark (SciRerankBench), for evaluating rerankers within RAG-LLMs systems, spanning five scientific subjects. To rigorously assess the reranker performance in terms of noise resilience, relevance disambiguation, and factual consistency, we develop three types of question-context-answer (Q-C-A) pairs, i.e., Noisy Contexts (NC), Semantically Similar but Logically Irrelevant Contexts (SSLI), and Counterfactual Contexts (CC). Through systematic evaluation of 13 widely used rerankers on five families of LLMs, we provide detailed insights into their relative strengths and limitations. To the best of our knowledge, SciRerankBench is the first benchmark specifically developed to evaluate rerankers within RAG-LLMs, which provides valuable observations and guidance for their future development.
title SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generated LLMs
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2508.08742