Cover Image

Beyond Content Relevance: Evaluating Instruction Following in Retrieval Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhou, Jianqun, Zheng, Yuanlei, Chen, Wei, Zheng, Qianqian, Su, Hui, Zhang, Wei, Meng, Rui, Shen, Xiaoyu
Format:	Preprint
Published:	2024
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Beyond Relevance: Evaluate and Improve Retrievers on Perspective Awareness
by: Zhao, Xinran, et al.
Published: (2024)

Generative Retrieval Meets Multi-Graded Relevance
by: Tang, Yubao, et al.
Published: (2024)

Towards Better Instruction Following Retrieval Models
by: Zhuang, Yuchen, et al.
Published: (2025)

FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
by: Weller, Orion, et al.
Published: (2024)

Dual-View Training for Instruction-Following Information Retrieval
by: Zeng, Qingcheng, et al.
Published: (2026)

AutoMIR: Effective Zero-Shot Medical Information Retrieval without Relevance Labels
by: Li, Lei, et al.
Published: (2024)

Towards Boosting LLMs-driven Relevance Modeling with Progressive Retrieved Behavior-augmented Prompting
by: Chen, Zeyuan, et al.
Published: (2024)

Prism-Reranker: Beyond Relevance Scoring -- Jointly Producing Contributions and Evidence for Agentic Retrieval
by: Zhang, Dun
Published: (2026)

Tools are under-documented: Simple Document Expansion Boosts Tool Retrieval
by: Lu, Xuan, et al.
Published: (2025)

Beyond Semantic Relevance: Counterfactual Risk Minimization for Robust Retrieval-Augmented Generation
by: Liu, Peiyang, et al.
Published: (2026)

PairDistill: Pairwise Relevance Distillation for Dense Retrieval
by: Huang, Chao-Wei, et al.
Published: (2024)

Beyond Relevance: Improving User Engagement by Personalization for Short-Video Search
by: Bao, Wentian, et al.
Published: (2024)

FollowTable: A Benchmark for Instruction-Following Table Retrieval
by: Jin, Rihui, et al.
Published: (2026)

Beyond Global Similarity: Towards Fine-Grained, Multi-Condition Multimodal Retrieval
by: Lu, Xuan, et al.
Published: (2026)

IRSC: A Zero-shot Evaluation Benchmark for Information Retrieval through Semantic Comprehension in Retrieval-Augmented Generation Scenarios
by: Lin, Hai, et al.
Published: (2024)

Beyond the Surface: A Solution-Aware Retrieval Model for Competition-level Code Generation
by: Zhang, Shiwen, et al.
Published: (2025)

Illusions of Relevance: Arbitrary Content Injection Attacks Deceive Retrievers, Rerankers, and LLM Judges
by: Tamber, Manveer Singh, et al.
Published: (2025)

Harnessing the Power of Reinforcement Learning for Language-Model-Based Information Retriever via Query-Document Co-Augmentation
by: Liu, Jingming, et al.
Published: (2025)

MMEB-V3: Measuring the Performance Gaps of Omni-Modality Embedding Models
by: Huang, Haohang, et al.
Published: (2026)

MultiConIR: Towards multi-condition Information Retrieval
by: Lu, Xuan, et al.
Published: (2025)

Limitations of Automatic Relevance Assessments with Large Language Models for Fair and Reliable Retrieval Evaluation
by: Otero, David, et al.
Published: (2024)

An Exam-based Evaluation Approach Beyond Traditional Relevance Judgments
by: Farzi, Naghmeh, et al.
Published: (2024)

Towards an In-Depth Comprehension of Case Relevance for Better Legal Retrieval
by: Li, Haitao, et al.
Published: (2024)

InstructRAG: Leveraging Retrieval-Augmented Generation on Instruction Graphs for LLM-Based Task Planning
by: Wang, Zheng, et al.
Published: (2025)

IFIR: A Comprehensive Benchmark for Evaluating Instruction-Following in Expert-Domain Information Retrieval
by: Song, Tingyu, et al.
Published: (2025)

Axiomatic Causal Interventions for Reverse Engineering Relevance Computation in Neural Retrieval Models
by: Chen, Catherine, et al.
Published: (2024)

Learning to Trust: Dynamic Utilization of Retrieval-Augmented Generation for E-commerce Search Relevance
by: Xu, Tingqiao, et al.
Published: (2025)

Beyond Relevance: On the Relationship Between Retrieval and RAG Information Coverage
by: Samuel, Saron, et al.
Published: (2026)

Is Relevance an Adequate Criterion for Retrieval System Evaluation: An Empirical Inquiry into the User's Evaluation.
by: Su, Louise T.
Published: (1993)

Interact-RAG: Reason and Interact with the Corpus, Beyond Black-Box Retrieval
by: Hui, Yulong, et al.
Published: (2025)

Optimizing Recall or Relevance? A Multi-Task Multi-Head Approach for Item-to-Item Retrieval in Recommendation
by: Zhang, Jiang, et al.
Published: (2025)

SEMINAR: Search Enhanced Multi-modal Interest Network and Approximate Retrieval for Lifelong Sequential Recommendation
by: Shen, Kaiming, et al.
Published: (2024)

From Relevance to Utility: Evidence Retrieval with Feedback for Fact Verification
by: Zhang, Hengran, et al.
Published: (2023)

Adaptive Domain Scaling for Personalized Sequential Modeling in Recommenders
by: Chai, Zheng, et al.
Published: (2025)

Optimizing Retrieval-Augmented Generation with Elasticsearch for Enhanced Question-Answering Systems
by: Chen, Jiajing, et al.
Published: (2024)

Beyond Benchmarks: Evaluating Embedding Model Similarity for Retrieval Augmented Generation Systems
by: Caspari, Laura, et al.
Published: (2024)

Is Relevance Propagated from Retriever to Generator in RAG?
by: Tian, Fangzheng, et al.
Published: (2025)

DiffHash: Text-Guided Targeted Attack via Diffusion Models against Deep Hashing Image Retrieval
by: Liu, Zechao, et al.
Published: (2025)

RAG Meets Temporal Graphs: Time-Sensitive Modeling and Retrieval for Evolving Knowledge
by: Han, Jiale, et al.
Published: (2025)

R2MED: A Benchmark for Reasoning-Driven Medical Retrieval
by: Zhang, Xiangxu, et al.
Published: (2025)