RAG-Match: Retrieval-Augmented Knowledge Injection and Hierarchical Reasoning for Calibrated Semantic Relevance

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Jiang, Hengjun, Sun, Liansheng, Jiang, Yan, Ke, Xiaojie, Wang, Yongjin, Liu, Xiangkun, Gu, Cunxin, Xu, Jian, Jiang, Guanjun
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916044624363520
author Jiang, Hengjun
Sun, Liansheng
Jiang, Yan
Ke, Xiaojie
Wang, Yongjin
Liu, Xiangkun
Gu, Cunxin
Xu, Jian
Jiang, Guanjun
author_facet Jiang, Hengjun
Sun, Liansheng
Jiang, Yan
Ke, Xiaojie
Wang, Yongjin
Liu, Xiangkun
Gu, Cunxin
Xu, Jian
Jiang, Guanjun
contents Semantic relevance judgment for search is particularly challenging in knowledge-intensive scenarios, where accurate ranking requires not only semantic matching but also background grounding, multi-step reasoning, and well-calibrated decision boundaries. Existing relevance models mainly rely on direct label supervision or shallow semantic similarity, which limits their ability to handle implicit intent, factual equivalence, and fine-grained relevance distinctions. To address this issue, we propose \textsc{RAG-Match}, a three-stage framework that integrates knowledge-augmented pretraining, hierarchical reasoning alignment, and preference-based decision calibration for relevance modeling. The key idea is to first strengthen query-centered semantic grounding, then align the model with structured relevance reasoning, and finally correct decision-level inconsistencies in difficult boundary cases. Experimental results on a real-world search relevance benchmark show that \textsc{RAG-Match} consistently outperforms strong LLM-based baselines across multiple ranking metrics, demonstrating the effectiveness of combining knowledge injection, reasoning supervision, and preference optimization for fine-grained relevance judgment.
format Preprint
id arxiv_https___arxiv_org_abs_2605_25486
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle RAG-Match: Retrieval-Augmented Knowledge Injection and Hierarchical Reasoning for Calibrated Semantic Relevance
Jiang, Hengjun
Sun, Liansheng
Jiang, Yan
Ke, Xiaojie
Wang, Yongjin
Liu, Xiangkun
Gu, Cunxin
Xu, Jian
Jiang, Guanjun
Information Retrieval
Semantic relevance judgment for search is particularly challenging in knowledge-intensive scenarios, where accurate ranking requires not only semantic matching but also background grounding, multi-step reasoning, and well-calibrated decision boundaries. Existing relevance models mainly rely on direct label supervision or shallow semantic similarity, which limits their ability to handle implicit intent, factual equivalence, and fine-grained relevance distinctions. To address this issue, we propose \textsc{RAG-Match}, a three-stage framework that integrates knowledge-augmented pretraining, hierarchical reasoning alignment, and preference-based decision calibration for relevance modeling. The key idea is to first strengthen query-centered semantic grounding, then align the model with structured relevance reasoning, and finally correct decision-level inconsistencies in difficult boundary cases. Experimental results on a real-world search relevance benchmark show that \textsc{RAG-Match} consistently outperforms strong LLM-based baselines across multiple ranking metrics, demonstrating the effectiveness of combining knowledge injection, reasoning supervision, and preference optimization for fine-grained relevance judgment.
title RAG-Match: Retrieval-Augmented Knowledge Injection and Hierarchical Reasoning for Calibrated Semantic Relevance
topic Information Retrieval
url https://arxiv.org/abs/2605.25486