Logic-Oriented Retriever Enhancement via Contrastive Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Wenxuan, Jiang, Yuan-Hao, Qi, Changyong, Jia, Rui, Wu, Yonghe
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915767251894272
author Zhang, Wenxuan
Jiang, Yuan-Hao
Qi, Changyong
Jia, Rui
Wu, Yonghe
author_facet Zhang, Wenxuan
Jiang, Yuan-Hao
Qi, Changyong
Jia, Rui
Wu, Yonghe
contents Large language models (LLMs) struggle in knowledge-intensive tasks, as retrievers often overfit to surface similarity and fail on queries involving complex logical relations. The capacity for logical analysis is inherent in model representations but remains underutilized in standard training. LORE (Logic ORiented Retriever Enhancement) introduces fine-grained contrastive learning to activate this latent capacity, guiding embeddings toward evidence aligned with logical structure rather than shallow similarity. LORE requires no external upervision, resources, or pre-retrieval analysis, remains index-compatible, and consistently improves retrieval utility and downstream generation while maintaining efficiency. The datasets and code are publicly available at https://github.com/mazehart/Lore-RAG.
format Preprint
id arxiv_https___arxiv_org_abs_2602_01116
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Logic-Oriented Retriever Enhancement via Contrastive Learning
Zhang, Wenxuan
Jiang, Yuan-Hao
Qi, Changyong
Jia, Rui
Wu, Yonghe
Computation and Language
Large language models (LLMs) struggle in knowledge-intensive tasks, as retrievers often overfit to surface similarity and fail on queries involving complex logical relations. The capacity for logical analysis is inherent in model representations but remains underutilized in standard training. LORE (Logic ORiented Retriever Enhancement) introduces fine-grained contrastive learning to activate this latent capacity, guiding embeddings toward evidence aligned with logical structure rather than shallow similarity. LORE requires no external upervision, resources, or pre-retrieval analysis, remains index-compatible, and consistently improves retrieval utility and downstream generation while maintaining efficiency. The datasets and code are publicly available at https://github.com/mazehart/Lore-RAG.
title Logic-Oriented Retriever Enhancement via Contrastive Learning
topic Computation and Language
url https://arxiv.org/abs/2602.01116