Cover Image

IRSC: A Zero-shot Evaluation Benchmark for Information Retrieval through Semantic Comprehension in Retrieval-Augmented Generation Scenarios

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lin, Hai, Zhan, Shaoxiong, Su, Junyou, Zheng, Haitao, Wang, Hui
Format:	Preprint
Published:	2024
Subjects:	Information Retrieval Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

QAEA-DR: A Unified Text Augmentation Framework for Dense Retrieval
by: Tan, Hongming, et al.
Published: (2024)

RALLM-POI: Retrieval-Augmented LLM for Zero-shot Next POI Recommendation with Geographical Reranking
by: Li, Kunrong, et al.
Published: (2025)

FRESCO: Benchmarking and Optimizing Re-rankers for Evolving Semantic Conflict in Retrieval-Augmented Generation
by: An, Sohyun, et al.
Published: (2026)

Fishing for Answers: Exploring One-shot vs. Iterative Retrieval Strategies for Retrieval Augmented Generation
by: Lin, Huifeng, et al.
Published: (2025)

UDA: A Benchmark Suite for Retrieval Augmented Generation in Real-world Document Analysis
by: Hui, Yulong, et al.
Published: (2024)

Zero-shot Multimodal Document Retrieval via Cross-modal Question Generation
by: Choi, Yejin, et al.
Published: (2025)

Benchmarking Retrieval-Augmented Generation for Chemistry
by: Zhong, Xianrui, et al.
Published: (2025)

PIR-RAG: A System for Private Information Retrieval in Retrieval-Augmented Generation
by: Wang, Baiqiang, et al.
Published: (2025)

RAGe: A Retrieval-Augmented Generation Evaluation Framework
by: Guder, Larissa, et al.
Published: (2026)

DisastIR: A Comprehensive Information Retrieval Benchmark for Disaster Management
by: Yin, Kai, et al.
Published: (2025)

STAR: Semantic-Tuned and Tail-Adaptive Retriever for Graph-Augmented Generation
by: Li, Shuai, et al.
Published: (2026)

TrustRAG: An Information Assistant with Retrieval Augmented Generation
by: Fan, Yixing, et al.
Published: (2025)

Comprehensive and Practical Evaluation of Retrieval-Augmented Generation Systems for Medical Question Answering
by: Ngo, Nghia Trung, et al.
Published: (2024)

StratRAG: A Multi-Hop Retrieval Evaluation Dataset for Retrieval-Augmented Generation Systems
by: Patodiya, Aryan
Published: (2026)

Worse than Zero-shot? A Fact-Checking Dataset for Evaluating the Robustness of RAG Against Misleading Retrievals
by: Zeng, Linda, et al.
Published: (2025)

HypRAG: Hyperbolic Dense Retrieval for Retrieval Augmented Generation
by: Madhu, Hiren, et al.
Published: (2026)

Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendation
by: Cui, Ziqiang, et al.
Published: (2025)

RAGdb: A Zero-Dependency, Embeddable Architecture for Multimodal Retrieval-Augmented Generation on the Edge
by: Khalid, Ahmed Bin
Published: (2025)

R^2AG: Incorporating Retrieval Information into Retrieval Augmented Generation
by: Ye, Fuda, et al.
Published: (2024)

TBGRecall: A Generative Retrieval Model for E-commerce Recommendation Scenarios
by: Liang, Zida, et al.
Published: (2025)

KG-Retriever: Efficient Knowledge Indexing for Retrieval-Augmented Large Language Models
by: Chen, Weijie, et al.
Published: (2024)

LexSemBridge: Fine-Grained Dense Representation Enhancement through Token-Aware Embedding Augmentation
by: Zhan, Shaoxiong, et al.
Published: (2025)

InRanker: Distilled Rankers for Zero-shot Information Retrieval
by: Laitz, Thiago, et al.
Published: (2024)

Fine-Grained Guidance for Retrievers: Leveraging LLMs' Feedback in Retrieval-Augmented Generation
by: Liu, Yuhang, et al.
Published: (2024)

Parametric Retrieval-Augmented Generation using Latent Routing of LoRA Adapters
by: Su, Zhan, et al.
Published: (2025)

DICE: Discrete Interpretable Comparative Evaluation with Probabilistic Scoring for Retrieval-Augmented Generation
by: Liu, Shiyan, et al.
Published: (2025)

Evaluating Chunking Strategies For Retrieval-Augmented Generation in Oil and Gas Enterprise Documents
by: Taiwo, Samuel, et al.
Published: (2026)

BEIR-PL: Zero Shot Information Retrieval Benchmark for the Polish Language
by: Wojtasik, Konrad, et al.
Published: (2023)

Fast or Better? Balancing Accuracy and Cost in Retrieval-Augmented Generation with Flexible User Control
by: Su, Jinyan, et al.
Published: (2025)

AutoMIR: Effective Zero-Shot Medical Information Retrieval without Relevance Labels
by: Li, Lei, et al.
Published: (2024)

Dynamic and Parametric Retrieval-Augmented Generation
by: Su, Weihang, et al.
Published: (2025)

GainRAG: Preference Alignment in Retrieval-Augmented Generation through Gain Signal Synthesis
by: Jiang, Yi, et al.
Published: (2025)

Engineering the RAG Stack: A Comprehensive Review of the Architecture and Trust Frameworks for Retrieval-Augmented Generation Systems
by: Wampler, Dean, et al.
Published: (2025)

Benchmarking Information Retrieval Models on Complex Retrieval Tasks
by: Killingback, Julian, et al.
Published: (2025)

Blended RAG: Improving RAG (Retriever-Augmented Generation) Accuracy with Semantic Search and Hybrid Query-Based Retrievers
by: Sawarkar, Kunal, et al.
Published: (2024)

Optimizing and Evaluating Enterprise Retrieval-Augmented Generation (RAG): A Content Design Perspective
by: Packowski, Sarah, et al.
Published: (2024)

Retrieval-Augmented Generation in Industry: An Interview Study on Use Cases, Requirements, Challenges, and Evaluation
by: Brehme, Lorenz, et al.
Published: (2025)

Retrieval-Augmented Process Reward Model for Generalizable Mathematical Reasoning
by: Zhu, Jiachen, et al.
Published: (2025)

Agentic Information Retrieval
by: Zhang, Weinan, et al.
Published: (2024)

LightRAG: Simple and Fast Retrieval-Augmented Generation
by: Guo, Zirui, et al.
Published: (2024)