Cover Image

Total Recall QA: A Verifiable Evaluation Suite for Deep Research Agents

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Rafiee, Mahta, Soudani, Heydar, Abbasiantaeb, Zahra, Aliannejadi, Mohammad, Hasibi, Faegheh, Zamani, Hamed
Format:	Preprint
Published:	2026
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Uncertainty Quantification for Retrieval-Augmented Reasoning
by: Soudani, Heydar, et al.
Published: (2025)

Why Uncertainty Estimation Methods Fall Short in RAG: An Axiomatic Analysis
by: Soudani, Heydar, et al.
Published: (2025)

Data Augmentation for Conversational AI
by: Soudani, Heydar, et al.
Published: (2023)

A Survey on Recent Advances in Conversational Data Generation
by: Soudani, Heydar, et al.
Published: (2024)

Generating Multi-Aspect Queries for Conversational Search
by: Abbasiantaeb, Zahra, et al.
Published: (2024)

IRLab@iKAT24: Learned Sparse Retrieval with Multi-aspect LLM Query Generation for Conversational Search
by: Lupart, Simon, et al.
Published: (2024)

Scaling Laws for Embedding Dimension in Information Retrieval
by: Killingback, Julian, et al.
Published: (2026)

Improving the Reusability of Conversational Search Test Collections
by: Abbasiantaeb, Zahra, et al.
Published: (2025)

FACE: A Fine-Grained Reference-Free Evaluator for Conversational Information Access
by: Joko, Hideaki, et al.
Published: (2025)

Conversational Gold: Evaluating Personalized Conversational Search System using Gold Nuggets
by: Abbasiantaeb, Zahra, et al.
Published: (2025)

Can We Use Large Language Models to Fill Relevance Judgment Holes?
by: Abbasiantaeb, Zahra, et al.
Published: (2024)

Towards Fair Rankings: Leveraging LLMs for Gender Bias Detection and Measurement
by: Mousavian, Maryam, et al.
Published: (2025)

Interactions with Generative Information Retrieval Systems
by: Aliannejadi, Mohammad, et al.
Published: (2024)

TREC iKAT 2023: A Test Collection for Evaluating Conversational and Interactive Knowledge Assistants
by: Aliannejadi, Mohammad, et al.
Published: (2024)

TREC iKAT 2023: The Interactive Knowledge Assistance Track Overview
by: Aliannejadi, Mohammad, et al.
Published: (2024)

Do Images Clarify? A Study on the Effect of Images on Clarifying Questions in Conversational Search
by: Siro, Clemencia, et al.
Published: (2026)

Fine Tuning vs. Retrieval Augmented Generation for Less Popular Knowledge
by: Soudani, Heydar, et al.
Published: (2024)

CRS Arena: Crowdsourced Benchmarking of Conversational Recommender Systems
by: Bernard, Nolwenn, et al.
Published: (2024)

LUMI: Unsupervised Intent Clustering with Multiple Pseudo-Labels
by: Lin, I-Fan, et al.
Published: (2025)

Graph-Embedding Empowered Entity Retrieval
by: Gerritse, Emma J., et al.
Published: (2025)

WildClaims: Information Access Conversations in the Wild(Chat)
by: Joko, Hideaki, et al.
Published: (2025)

LaMP-QA: A Benchmark for Personalized Long-form Question Answering
by: Salemi, Alireza, et al.
Published: (2025)

Adaptive Orchestration of Modular Generative Information Access Systems
by: Hoveyda, Mohanna, et al.
Published: (2025)

Real World Conversational Entity Linking Requires More Than Zeroshots
by: Hoveyda, Mohanna, et al.
Published: (2024)

Evaluating Retrieval Quality in Retrieval-Augmented Generation
by: Salemi, Alireza, et al.
Published: (2024)

Doing Personal LAPS: LLM-Augmented Dialogue Construction for Personalized Multi-Session Conversational Search
by: Joko, Hideaki, et al.
Published: (2024)

ProCIS: A Benchmark for Proactive Retrieval in Conversations
by: Samarinas, Chris, et al.
Published: (2024)

Evaluation of Agents under Simulated AI Marketplace Dynamics
by: Kim, To Eun, et al.
Published: (2026)

Reproducing Complex Set-Compositional Information Retrieval
by: Degenhart, Vincent, et al.
Published: (2026)

Reliable Annotations with Less Effort: Evaluating LLM-Human Collaboration in Search Clarifications
by: Tavakoli, Leila, et al.
Published: (2025)

OrLog: Resolving Complex Queries with LLMs and Probabilistic Reasoning
by: Hoveyda, Mohanna, et al.
Published: (2026)

LLM-Evaluation Tropes: Perspectives on the Validity of LLM-Evaluations
by: Dietz, Laura, et al.
Published: (2025)

Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs
by: Siro, Clemencia, et al.
Published: (2024)

CIIR@LiveRAG 2025: Optimizing Multi-Agent Retrieval Augmented Generation through Self-Training
by: Salemi, Alireza, et al.
Published: (2025)

Open-Ended and Knowledge-Intensive Video Question Answering
by: Alam, Md Zarif Ul, et al.
Published: (2025)

Scaling Sparse and Dense Retrieval in Decoder-Only LLMs
by: Zeng, Hansi, et al.
Published: (2025)

Recall, Robustness, and Lexicographic Evaluation
by: Diaz, Fernando, et al.
Published: (2023)

Distillation and Refinement of Reasoning in Small Language Models for Document Re-ranking
by: Samarinas, Chris, et al.
Published: (2025)

Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Models
by: Salemi, Alireza, et al.
Published: (2024)

Learning to Rank for Multiple Retrieval-Augmented Models through Iterative Utility Maximization
by: Salemi, Alireza, et al.
Published: (2024)