Cover Image

The Effect of Document Summarization on LLM-Based Relevance Judgments

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mohtadi, Samaneh, Roitero, Kevin, Mizzaro, Stefano, Demartini, Gianluca
Format:	Preprint
Published:	2025
Subjects:	Information Retrieval Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Query-Document Dense Vectors for LLM Relevance Judgment Bias Analysis
by: Mohtadi, Samaneh, et al.
Published: (2026)

Efficiency and Effectiveness of LLM-Based Summarization of Evidence in Crowdsourced Fact-Checking
by: Roitero, Kevin, et al.
Published: (2025)

DIRAS: Efficient LLM Annotation of Document Relevance in Retrieval Augmented Generation
by: Ni, Jingwei, et al.
Published: (2024)

On Robustness and Reliability of Benchmark-Based Evaluation of LLMs
by: Lunardi, Riccardo, et al.
Published: (2025)

JuDGE: Benchmarking Judgment Document Generation for Chinese Legal System
by: Su, Weihang, et al.
Published: (2025)

An Iterative Utility Judgment Framework Inspired by Philosophical Relevance via LLMs
by: Zhang, Hengran, et al.
Published: (2024)

Enhancing Judgment Document Generation via Agentic Legal Information Collection and Rubric-Guided Optimization
by: Su, Weihang, et al.
Published: (2026)

Optimizing LLMs with Direct Preferences: A Data Efficiency Perspective
by: Bernardelle, Pietro, et al.
Published: (2024)

Explainable LLM-driven Multi-dimensional Distillation for E-Commerce Relevance Learning
by: Zhao, Gang, et al.
Published: (2024)

Benchmarking LLM-based Relevance Judgment Methods
by: Arabzadeh, Negar, et al.
Published: (2025)

STRUM-LLM: Attributed and Structured Contrastive Summarization
by: Gunel, Beliz, et al.
Published: (2024)

Leveraging the Power of LLMs: A Fine-Tuning Approach for High-Quality Aspect-Based Summarization
by: Mullick, Ankan, et al.
Published: (2024)

Thesis: Document Summarization with applications to Keyword extraction and Image Retrieval
by: Sundararaj, Jayaprakash
Published: (2024)

Leveraging Hierarchical Organization for Medical Multi-document Summarization
by: Hsu, Yi-Li, et al.
Published: (2025)

A Human-AI Comparative Analysis of Prompt Sensitivity in LLM-Based Relevance Judgment
by: Arabzadeh, Negar, et al.
Published: (2025)

Enhancing Abstractive Summarization of Scientific Papers Using Structure Information
by: Bao, Tong, et al.
Published: (2025)

Beyond Relevance: Utility-Centric Retrieval in the LLM Era
by: Zhang, Hengran, et al.
Published: (2026)

MCERF: Advancing Multimodal LLM Evaluation of Engineering Documentation with Enhanced Retrieval
by: Khanghah, Kiarash Naghavi, et al.
Published: (2026)

Mapping and Influencing the Political Ideology of Large Language Models using Synthetic Personas
by: Bernardelle, Pietro, et al.
Published: (2024)

ADORE: Autonomous Domain-Oriented Relevance Engine for E-commerce
by: Fang, Zheng, et al.
Published: (2025)

Biomedical Question Answering via Multi-Level Summarization on a Local Knowledge Graph
by: Guan, Lingxiao, et al.
Published: (2025)

Towards a Robust Retrieval-Based Summarization System
by: Liu, Shengjie, et al.
Published: (2024)

Improve Rule Retrieval and Reasoning with Self-Induction and Relevance ReEstimate
by: Huang, Ziyang, et al.
Published: (2025)

TaoSR1: The Thinking Model for E-commerce Relevance Search
by: Dong, Chenhe, et al.
Published: (2025)

Query Performance Prediction using Relevance Judgments Generated by Large Language Models
by: Meng, Chuan, et al.
Published: (2024)

FG-RAG: Enhancing Query-Focused Summarization with Context-Aware Fine-Grained Graph RAG
by: Hong, Yubin, et al.
Published: (2025)

An Auditable Pipeline for Fuzzy Full-Text Screening in Systematic Reviews: Integrating Contrastive Semantic Highlighting and LLM Judgment
by: Mortezaagha, Pouria, et al.
Published: (2025)

Fine-tuning Small Language Models as Efficient Enterprise Search Relevance Labelers
by: Kang, Yue, et al.
Published: (2026)

Retrieve Only Relevant Tables Whether Few or Many: Adaptive Table Retrieval Method
by: Kim, Taehee, et al.
Published: (2026)

Deep Bag-of-Words Model: An Efficient and Interpretable Relevance Architecture for Chinese E-Commerce
by: Lin, Zhe, et al.
Published: (2024)

Within-Document Event Coreference with BERT-Based Contextualized Representations
by: Ahmed, Shafiuddin Rehan, et al.
Published: (2021)

Auto-ARGUE: LLM-Based Report Generation Evaluation
by: Walden, William, et al.
Published: (2025)

TaoSR-AGRL: Adaptive Guided Reinforcement Learning Framework for E-commerce Search Relevance
by: Yang, Jianhui, et al.
Published: (2025)

Perplexity Trap: PLM-Based Retrievers Overrate Low Perplexity Documents
by: Wang, Haoyu, et al.
Published: (2025)

Enhancing LLM Generation with Knowledge Hypergraph for Evidence-Based Medicine
by: Dou, Chengfeng, et al.
Published: (2025)

Scientific Paper Retrieval with LLM-Guided Semantic-Based Ranking
by: Zhang, Yunyi, et al.
Published: (2025)

Capturing Legal Reasoning Paths from Facts to Law in Court Judgments using Knowledge Graphs
by: Kondo, Ryoma, et al.
Published: (2025)

Mitigating the Threshold Priming Effect in Large Language Model-Based Relevance Judgments via Personality Infusing
by: Chen, Nuo, et al.
Published: (2025)

FinCARDS: Card-Based Analyst Reranking for Financial Document Question Answering
by: Zhou, Yixi, et al.
Published: (2026)

RDF-Based Structured Quality Assessment Representation of Multilingual LLM Evaluations
by: Gwozdz, Jonas, et al.
Published: (2025)