Cover Image

ConQRet: Benchmarking Fine-Grained Evaluation of Retrieval Augmented Argumentation with LLM Judges

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dhole, Kaustubh D., Shu, Kai, Agichtein, Eugene
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Artificial Intelligence Information Retrieval I.2.7
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RubricRAG: Towards Interpretable and Reliable LLM Evaluation via Domain Knowledge Retrieval for Rubric Generation
by: Dhole, Kaustubh D., et al.
Published: (2026)

Generative Query Reformulation Using Ensemble Prompting, Document Fusion, and Relevance Feedback
by: Dhole, Kaustubh D., et al.
Published: (2024)

To Retrieve or Not to Retrieve? Uncertainty Detection for Dynamic Retrieval Augmented Generation
by: Dhole, Kaustubh D.
Published: (2025)

KAUCUS: Knowledge Augmented User Simulators for Training Language Model Assistants
by: Dhole, Kaustubh D.
Published: (2024)

GenQREnsemble: Zero-Shot LLM Ensemble Prompting for Generative Query Reformulation
by: Dhole, Kaustubh, et al.
Published: (2024)

InsertRank: LLMs can reason over BM25 scores to Improve Listwise Reranking
by: Seetharaman, Rahul, et al.
Published: (2025)

Evaluating Hybrid Retrieval Augmented Generation using Dynamic Test Sets: LiveRAG Challenge
by: Fensore, Chase, et al.
Published: (2025)

Leveraging Retrieval Augmented Generative LLMs For Automated Metadata Description Generation to Enhance Data Catalogs
by: Singh, Mayank, et al.
Published: (2025)

Retrieval-Enhanced Named Entity Recognition
by: Shiraishi, Enzo, et al.
Published: (2024)

Prompt Perturbation in Retrieval-Augmented Generation based Large Language Models
by: Hu, Zhibo, et al.
Published: (2024)

DUQGen: Effective Unsupervised Domain Adaptation of Neural Rankers by Diversifying Synthetic Query Generation
by: Chandradevan, Ramraj, et al.
Published: (2024)

Adversarial Lens: Exploiting Attention Layers to Generate Adversarial Examples for Evaluation
by: Dhole, Kaustubh
Published: (2025)

VERA: Validation and Evaluation of Retrieval-Augmented Systems
by: Ding, Tianyu, et al.
Published: (2024)

A Multi-Encoder Frozen-Decoder Approach for Fine-Tuning Large Language Models
by: Dhole, Kaustubh D.
Published: (2025)

BabyReasoningBench: Generating Developmentally-Inspired Reasoning Tasks for Evaluating Baby Language Models
by: Dhole, Kaustubh D.
Published: (2026)

Query-Centric Graph Retrieval Augmented Generation
by: Wu, Yaxiong, et al.
Published: (2025)

Augmented Relevance Datasets with Fine-Tuned Small LLMs
by: Fitte-Rey, Quentin, et al.
Published: (2025)

A Comparative Analysis of Retrieval-Augmented Generation Techniques for Bengali Standard-to-Dialect Machine Translation Using LLMs
by: Sami, K. M. Jubair, et al.
Published: (2025)

Benchmarking Retrieval Strategies for Biomedical Retrieval-Augmented Generation: A Controlled Empirical Study
by: Bal, Devi Prasad, et al.
Published: (2026)

Walk&Retrieve: Simple Yet Effective Zero-shot Retrieval-Augmented Generation via Knowledge Graph Walks
by: Böckling, Martin, et al.
Published: (2025)

MLDocRAG: Multimodal Long-Context Document Retrieval Augmented Generation
by: Zhang, Yongyue, et al.
Published: (2026)

SURE-RAG: Sufficiency and Uncertainty-Aware Evidence Verification for Selective Retrieval-Augmented Generation
by: Qiu, Jingxi, et al.
Published: (2026)

MATH-PT: A Math Reasoning Benchmark for European and Brazilian Portuguese
by: Teixeira, Tiago, et al.
Published: (2026)

Document Understanding for Healthcare Referrals
by: Mistry, Jimit, et al.
Published: (2023)

ARAGOG: Advanced RAG Output Grading
by: Eibich, Matouš, et al.
Published: (2024)

Efficient Knowledge Feeding to Language Models: A Novel Integrated Encoder-Decoder Architecture
by: Kumar, S Santosh, et al.
Published: (2025)

Building Entity Association Mining Framework for Knowledge Discovery
by: Rawal, Anshika, et al.
Published: (2025)

EnterpriseEM: Fine-tuned Embeddings for Enterprise Semantic Search
by: Rathinasamy, Kamalkumar, et al.
Published: (2024)

Using LLM-Based Approaches to Enhance and Automate Topic Labeling
by: Khandelwal, Trishia
Published: (2025)

Graph Your Way to Inspiration: Integrating Co-Author Graphs with Retrieval-Augmented Generation for Large Language Model Based Scientific Idea Generation
by: Xie, Pengzhen, et al.
Published: (2025)

Temporal Decay of Co-Citation Predictability: A 20-Year Statute Retrieval Benchmark from 396M Ukrainian Court Citations
by: Ovcharov, Volodymyr
Published: (2026)

Evaluating Perspectival Biases in Cross-Modal Retrieval
by: Saengsukhiran, Teerapol, et al.
Published: (2025)

Improving RAG Retrieval via Propositional Content Extraction: a Speech Act Theory Approach
by: Lima, João Alberto de Oliveira
Published: (2025)

Language Models and Retrieval Augmented Generation for Automated Structured Data Extraction from Diagnostic Reports
by: Jabal, Mohamed Sobhi, et al.
Published: (2024)

RecaLLM: Addressing the Lost-in-Thought Phenomenon with Explicit In-Context Retrieval
by: Whitecross, Kyle, et al.
Published: (2026)

AuthorityBench: Benchmarking LLM Authority Perception for Reliable Retrieval-Augmented Generation
by: Yao, Zhihui, et al.
Published: (2026)

Detection of ChatGPT Fake Science with the xFakeSci Learning Algorithm
by: Hamed, Ahmed Abdeen, et al.
Published: (2023)

SomaliWeb v1: A Quality-Filtered Somali Web Corpus with a Matched Tokenizer and a Public Language-Identification Benchmark
by: Dahir, Khalid Yusuf
Published: (2026)

CUE-R: Beyond the Final Answer in Retrieval-Augmented Generation
by: Jain, Siddharth, et al.
Published: (2026)

Confident, Calibrated, or Complicit: Safety Alignment and Ideological Bias in LLM Hate Speech Detection
by: Selvaganapathy, Sanjeeevan, et al.
Published: (2025)