Cover Image

Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pradeep, Ronak, Thakur, Nandan, Upadhyay, Shivani, Campos, Daniel, Craswell, Nick, Lin, Jimmy
Format:	Preprint
Published:	2024
Subjects:	Information Retrieval Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models
by: Pradeep, Ronak, et al.
Published: (2025)

Overview of the TREC 2025 Retrieval Augmented Generation (RAG) Track
by: Upadhyay, Shivani, et al.
Published: (2026)

Support Evaluation for the TREC 2024 RAG Track: Comparing Human versus LLM Judges
by: Thakur, Nandan, et al.
Published: (2025)

Chatbot Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses
by: Sharifymoghaddam, Sahel, et al.
Published: (2025)

Ragnarök: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track
by: Pradeep, Ronak, et al.
Published: (2024)

UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor
by: Upadhyay, Shivani, et al.
Published: (2024)

A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look
by: Upadhyay, Shivani, et al.
Published: (2024)

Overview of the TREC 2021 deep learning track
by: Craswell, Nick, et al.
Published: (2025)

NuggetIndex: Governed Atomic Retrieval for Maintainable RAG
by: Zerhoudi, Saber, et al.
Published: (2026)

MedNuggetizer: Confidence-Based Information Nugget Extraction from Medical Documents
by: Donabauer, Gregor, et al.
Published: (2025)

Overview of the TREC 2022 deep learning track
by: Craswell, Nick, et al.
Published: (2025)

LANCER: LLM Reranking for Nugget Coverage
by: Ju, Jia-Huei, et al.
Published: (2026)

Overview of the TREC 2023 deep learning track
by: Craswell, Nick, et al.
Published: (2025)

UiS-IAI@LiveRAG: Retrieval-Augmented Information Nugget-Based Generation of Responses
by: Łajewska, Weronika, et al.
Published: (2025)

UniRAG: Universal Retrieval Augmentation for Large Vision Language Models
by: Sharifymoghaddam, Sahel, et al.
Published: (2024)

LLMs Can Patch Up Missing Relevance Judgments in Evaluation
by: Upadhyay, Shivani, et al.
Published: (2024)

Conversational Gold: Evaluating Personalized Conversational Search System using Gold Nuggets
by: Abbasiantaeb, Zahra, et al.
Published: (2025)

GINGER: Grounded Information Nugget-Based Generation of Responses
by: Łajewska, Weronika, et al.
Published: (2025)

An Early FIRST Reproduction and Improvements to Single-Token Decoding for Fast Listwise Reranking
by: Chen, Zijian, et al.
Published: (2024)

DoGMaTiQ: Automated Generation of Question-and-Answer Nuggets for Report Evaluation
by: Li, Bryan, et al.
Published: (2026)

Incorporating Q&A Nuggets into Retrieval-Augmented Generation
by: Dietz, Laura, et al.
Published: (2026)

Overview of the TREC 2024 NeuCLIR Track
by: Lawrie, Dawn, et al.
Published: (2025)

HLTCOE at TREC 2024 NeuCLIR Track
by: Yang, Eugene, et al.
Published: (2025)

Still Fresh? Evaluating Temporal Drift in Retrieval Benchmarks
by: Kuissi, Nathan, et al.
Published: (2026)

Overview of TREC 2024 Biomedical Generative Retrieval (BioGen) Track
by: Gupta, Deepak, et al.
Published: (2024)

Synthetic Test Collections for Retrieval Evaluation
by: Rahmani, Hossein A., et al.
Published: (2024)

Overview of the TREC 2023 NeuCLIR Track
by: Lawrie, Dawn, et al.
Published: (2024)

ORBIT: Scalable and Verifiable Data Generation for Search Agents on a Tight Budget
by: Thakur, Nandan, et al.
Published: (2026)

Hard Negatives, Hard Lessons: Revisiting Training Data Quality for Robust Information Retrieval with LLMs
by: Thakur, Nandan, et al.
Published: (2025)

On the Comprehensibility of Multi-structured Financial Documents using LLMs and Pre-processing Tools
by: Upadhyay, Shivani, et al.
Published: (2025)

Systematic Evaluation of Neural Retrieval Models on the Touché 2020 Argument Retrieval Subset of BEIR
by: Thakur, Nandan, et al.
Published: (2024)

Towards Group-aware Search Success
by: Wu, Haolun, et al.
Published: (2024)

Overview of the TREC 2025 RAGTIME Track
by: Lawrie, Dawn, et al.
Published: (2026)

FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents
by: Thakur, Nandan, et al.
Published: (2025)

From Questions to Trust Reports: A LLM-IR Framework for the TREC 2025 DRAGUN Track
by: Alwasiak, Ignacy, et al.
Published: (2026)

HLTCOE at TREC 2023 NeuCLIR Track
by: Yang, Eugene, et al.
Published: (2024)

TMU at TREC Clinical Trials Track 2023
by: Lahiri, Aritra Kumar, et al.
Published: (2024)

Overview of TREC 2025 Biomedical Generative Retrieval (BioGen) Track
by: Gupta, Deepak, et al.
Published: (2026)

Revisiting Human-vs-LLM judgments using the TREC Podcast Track
by: Mansour, Watheq, et al.
Published: (2026)

Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024
by: Rahmani, Hossein A., et al.
Published: (2024)