Imagen de Portada

UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Upadhyay, Shivani, Pradeep, Ronak, Thakur, Nandan, Craswell, Nick, Lin, Jimmy
Formato:	Preprint
Publicado:	2024
Materias:	Information Retrieval
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Overview of the TREC 2025 Retrieval Augmented Generation (RAG) Track
por: Upadhyay, Shivani, et al.
Publicado: (2026)

Initial Nugget Evaluation Results for the TREC 2024 RAG Track with the AutoNuggetizer Framework
por: Pradeep, Ronak, et al.
Publicado: (2024)

The Great Nugget Recall: Automating Fact Extraction and RAG Evaluation with Large Language Models
por: Pradeep, Ronak, et al.
Publicado: (2025)

Support Evaluation for the TREC 2024 RAG Track: Comparing Human versus LLM Judges
por: Thakur, Nandan, et al.
Publicado: (2025)

Chatbot Arena Meets Nuggets: Towards Explanations and Diagnostics in the Evaluation of LLM Responses
por: Sharifymoghaddam, Sahel, et al.
Publicado: (2025)

A Large-Scale Study of Relevance Assessments with Large Language Models: An Initial Look
por: Upadhyay, Shivani, et al.
Publicado: (2024)

Ragnarök: A Reusable RAG Framework and Baselines for TREC 2024 Retrieval-Augmented Generation Track
por: Pradeep, Ronak, et al.
Publicado: (2024)

An Early FIRST Reproduction and Improvements to Single-Token Decoding for Fast Listwise Reranking
por: Chen, Zijian, et al.
Publicado: (2024)

LLMs Can Patch Up Missing Relevance Judgments in Evaluation
por: Upadhyay, Shivani, et al.
Publicado: (2024)

UniRAG: Universal Retrieval Augmentation for Large Vision Language Models
por: Sharifymoghaddam, Sahel, et al.
Publicado: (2024)

ORBIT: Scalable and Verifiable Data Generation for Search Agents on a Tight Budget
por: Thakur, Nandan, et al.
Publicado: (2026)

Hard Negatives, Hard Lessons: Revisiting Training Data Quality for Robust Information Retrieval with LLMs
por: Thakur, Nandan, et al.
Publicado: (2025)

Still Fresh? Evaluating Temporal Drift in Retrieval Benchmarks
por: Kuissi, Nathan, et al.
Publicado: (2026)

On the Comprehensibility of Multi-structured Financial Documents using LLMs and Pre-processing Tools
por: Upadhyay, Shivani, et al.
Publicado: (2025)

Towards Group-aware Search Success
por: Wu, Haolun, et al.
Publicado: (2024)

Overview of the TREC 2021 deep learning track
por: Craswell, Nick, et al.
Publicado: (2025)

Does UMBRELA Work on Other LLMs?
por: Farzi, Naghmeh, et al.
Publicado: (2025)

Systematic Evaluation of Neural Retrieval Models on the Touché 2020 Argument Retrieval Subset of BEIR
por: Thakur, Nandan, et al.
Publicado: (2024)

JudgeBlender: Ensembling Judgments for Automatic Relevance Assessment
por: Rahmani, Hossein A., et al.
Publicado: (2024)

FreshStack: Building Realistic Benchmarks for Evaluating Retrieval on Technical Documents
por: Thakur, Nandan, et al.
Publicado: (2025)

RankLLM: A Python Package for Reranking with LLMs
por: Sharifymoghaddam, Sahel, et al.
Publicado: (2025)

Leveraging LLMs for Synthesizing Training Data Across Many Languages in Multilingual Dense Retrieval
por: Thakur, Nandan, et al.
Publicado: (2023)

Overview of the TREC 2022 deep learning track
por: Craswell, Nick, et al.
Publicado: (2025)

SynDL: A Large-Scale Synthetic Test Collection for Passage Retrieval
por: Rahmani, Hossein A., et al.
Publicado: (2024)

LLMs as Assessors: Right for the Right Reason?
por: Saha, Sourav, et al.
Publicado: (2026)

Synthetic Test Collections for Retrieval Evaluation
por: Rahmani, Hossein A., et al.
Publicado: (2024)

Towards Understanding Bias in Synthetic Data for Evaluation
por: Rahmani, Hossein A., et al.
Publicado: (2025)

Overview of the TREC 2023 deep learning track
por: Craswell, Nick, et al.
Publicado: (2025)

Operational Advice for Dense and Sparse Retrievers: HNSW, Flat, or Inverted Indexes?
por: Lin, Jimmy
Publicado: (2024)

VISA: Retrieval Augmented Generation with Visual Source Attribution
por: Ma, Xueguang, et al.
Publicado: (2024)

Large language models can accurately predict searcher preferences
por: Thomas, Paul, et al.
Publicado: (2023)

"Knowing When You Don't Know": A Multilingual Relevance Assessment Dataset for Robust Retrieval-Augmented Generation
por: Thakur, Nandan, et al.
Publicado: (2023)

Revisiting Feedback Models for HyDE
por: Jedidi, Nour, et al.
Publicado: (2025)

Rerank Before You Reason: Analyzing Reranking Tradeoffs through Effective Token Cost in Deep Search Agents
por: Sharifymoghaddam, Sahel, et al.
Publicado: (2026)

ConvKGYarn: Spinning Configurable and Scalable Conversational Knowledge Graph QA datasets with Large Language Models
por: Pradeep, Ronak, et al.
Publicado: (2024)

Open-Source Reproduction and Explainability Analysis of Corrective Retrieval Augmented Generation
por: Yalavarthi, Surya Vardhan
Publicado: (2026)

LLMJudge: LLMs for Relevance Judgments
por: Rahmani, Hossein A., et al.
Publicado: (2024)

Report on the 1st Workshop on Large Language Model for Evaluation in Information Retrieval (LLM4Eval 2024) at SIGIR 2024
por: Rahmani, Hossein A., et al.
Publicado: (2024)

Judging the Judges: A Collection of LLM-Generated Relevance Judgements
por: Rahmani, Hossein A., et al.
Publicado: (2025)

Illusions of Relevance: Arbitrary Content Injection Attacks Deceive Retrievers, Rerankers, and LLM Judges
por: Tamber, Manveer Singh, et al.
Publicado: (2025)