Cover Image

Formalized Information Needs Improve Large-Language-Model Relevance Judgments

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Keller, Jüri, Fröbe, Maik, Engelmann, Björn, Haak, Fabian, Breuer, Timo, Larsen, Birger, Schaer, Philipp
Format:	Preprint
Published:	2026
Subjects:	Information Retrieval H.3.3
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Investigating Bias in Political Search Query Suggestions by Relative Comparison with LLMs
by: Haak, Fabian, et al.
Published: (2024)

Auditing Search Query Suggestion Bias Through Recursive Algorithm Interrogation
by: Haak, Fabian, et al.
Published: (2026)

Evaluating Contrastive Feedback for Effective User Simulations
by: Kruff, Andreas Konstantin, et al.
Published: (2025)

Perception-Aware Bias Detection for Query Suggestions
by: Haak, Fabian, et al.
Published: (2026)

Dynamics in Search Engine Query Suggestions for European Politicians
by: Pradel, Franziska, et al.
Published: (2026)

Criteria-Based LLM Relevance Judgments
by: Farzi, Naghmeh, et al.
Published: (2025)

Large Language Models for Relevance Judgment in Product Search
by: Mehrdad, Navid, et al.
Published: (2024)

Multi-stage Large Language Model Pipelines Can Outperform GPT-4o in Relevance Assessment
by: Schnabel, Julian A., et al.
Published: (2025)

Relevance Filtering for Embedding-based Retrieval
by: Rossi, Nicholas, et al.
Published: (2024)

Enhancing Relevance of Embedding-based Retrieval at Walmart
by: Lin, Juexin, et al.
Published: (2024)

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales
by: Godfrey, Charles, et al.
Published: (2025)

Query Performance Prediction using Relevance Judgments Generated by Large Language Models
by: Meng, Chuan, et al.
Published: (2024)

Where Relevance Emerges: A Layer-Wise Study of Internal Attention for Zero-Shot Re-Ranking
by: Chen, Haodong, et al.
Published: (2026)

LLM-Assisted Relevance Assessments: When Should We Ask LLMs for Help?
by: Takehi, Rikiya, et al.
Published: (2024)

Text-like Encoding of Collaborative Information in Large Language Models for Recommendation
by: Zhang, Yang, et al.
Published: (2024)

Expanding Relevance Judgments for Medical Case-based Retrieval Task with Multimodal LLMs
by: Pires, Catarina, et al.
Published: (2025)

Improving E-commerce Search with Category-Aligned Retrieval
by: Aliev, Rauf
Published: (2025)

Pairwise Comparison for Bias Identification and Quantification
by: Haak, Fabian, et al.
Published: (2025)

Information Retrieval for Climate Impact
by: de Rijke, Maarten, et al.
Published: (2025)

JointRank: Rank Large Set with Single Pass
by: Dedov, Evgeny
Published: (2025)

An Intrinsic Framework of Information Retrieval Evaluation Measures
by: Giner, Fernando
Published: (2023)

MIRA: An LLM-Assisted Benchmark for Multi-Category Integrated Retrieval
by: Türkmen, Mehmet Deniz, et al.
Published: (2026)

WindTunnel -- A Framework for Community Aware Sampling of Large Corpora
by: Iannelli, Michael
Published: (2024)

HeterRec: Heterogeneous Information Transformer for Scalable Sequential Recommendation
by: Deng, Hao, et al.
Published: (2025)

ESANS: Effective and Semantic-Aware Negative Sampling for Large-Scale Retrieval Systems
by: Xing, Haibo, et al.
Published: (2025)

Boosting LLM-based Relevance Modeling with Distribution-Aware Robust Learning
by: Liu, Hong, et al.
Published: (2024)

Best in Tau@LLMJudge: Criteria-Based Relevance Evaluation with Llama3
by: Farzi, Naghmeh, et al.
Published: (2024)

CreAgent: Towards Long-Term Evaluation of Recommender System under Platform-Creator Information Asymmetry
by: Ye, Xiaopeng, et al.
Published: (2025)

KamerRaad: Enhancing Information Retrieval in Belgian National Politics through Hierarchical Summarization and Conversational Interfaces
by: Rogiers, Alexander, et al.
Published: (2024)

Diagnosing LLM-based Rerankers in Cold-Start Recommender Systems: Coverage, Exposure and Practical Mitigations
by: Lemdiasova, Ekaterina, et al.
Published: (2026)

Course Recommender Systems Need to Consider the Job Market
by: Frej, Jibril, et al.
Published: (2024)

Intent-Driven Dynamic Chunking: Segmenting Documents to Reflect Predicted Information Needs
by: Koutsiaris, Christos
Published: (2026)

Is Sliding Window All You Need? An Open Framework for Long-Sequence Recommendation
by: Chakrabarty, Sayak, et al.
Published: (2026)

Replicability Measures for Longitudinal Information Retrieval Evaluation
by: Keller, Jüri, et al.
Published: (2024)

Utilizing Large Language Models for Named Entity Recognition in Traditional Chinese Medicine against COVID-19 Literature: Comparative Study
by: Tong, Xu, et al.
Published: (2024)

Understanding Before Recommendation: Semantic Aspect-Aware Review Exploitation via Large Language Models
by: Liu, Fan, et al.
Published: (2023)

Graph-GRPO: Dependency-Aware Credit Assignment for Generative E-commerce Search Relevance
by: Che, Jiarui, et al.
Published: (2026)

Online Item Cold-Start Recommendation with Popularity-Aware Meta-Learning
by: Luo, Yunze, et al.
Published: (2024)

Exploring Content-Based and Meta-Data Analysis for Detecting Fake News Infodemic: A case study on COVID-19
by: Ajao, Oluwaseun, et al.
Published: (2024)

Content-Aware Tweet Location Inference using Quadtree Spatial Partitioning and Jaccard-Cosine Word Embedding
by: Ajao, Oluwaseun, et al.
Published: (2024)