LLM-Driven Usefulness Judgment for Web Search Evaluation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Dewan, Mouly, Liu, Jiqun, Gautam, Aditya, Shah, Chirag
Format:	Preprint
Published:	2025
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LLM-Driven Usefulness Labeling for IR Evaluation
by: Dewan, Mouly, et al.
Published: (2025)

TRUE: A Reproducible Framework for LLM-Driven Relevance Judgment in Information Retrieval
by: Dewan, Mouly, et al.
Published: (2025)

Mind Over Misinformation: Investigating the Factors of Cognitive Influences in Information Acceptance
by: Mouly Dewan, et al.
Published: (2024)

Cognitively Biased Users Interacting with Algorithmically Biased Results in Whole-Session Search on Debated Topics
by: Wang, Ben, et al.
Published: (2024)

Pairwise Judgment Formulation for Semantic Embedding Model in Web Search
by: Hong, Mengze, et al.
Published: (2024)

Mitigating the Threshold Priming Effect in Large Language Model-Based Relevance Judgments via Personality Infusing
by: Chen, Nuo, et al.
Published: (2025)

Not All Transparency Is Equal: Source Presentation Effects on Attention, Interaction, and Persuasion in Conversational Search
by: He, Jiangen, et al.
Published: (2025)

The Landscape of Data Reuse in Interactive Information Retrieval: Motivations, Sources, and Evaluation of Reusability
by: Jiang, Tianji, et al.
Published: (2024)

Decoy Effect In Search Interaction: Understanding User Behavior and Measuring System Vulnerability
by: Chen, Nuo, et al.
Published: (2024)

Decoy Effect in Search Interaction: A Pilot Study
by: Chen, Nuo, et al.
Published: (2023)

LLM-based Relevance Assessment for Web-Scale Search Evaluation at Pinterest
by: Wang, Han, et al.
Published: (2025)

Leveraging LLMs to Evaluate Usefulness of Document
by: Wang, Xingzhu, et al.
Published: (2025)

WebANNS: Fast and Efficient Approximate Nearest Neighbor Search in Web Browsers
by: Liu, Mugeng, et al.
Published: (2025)

Efficient and Responsible Adaptation of Large Language Models for Robust Top-k Recommendations
by: Kaur, Kirandeep, et al.
Published: (2024)

The Decoy Dilemma in Online Medical Information Evaluation: A Comparative Study of Credibility Assessments by LLM and Human Judges
by: Liu, Jiqun, et al.
Published: (2024)

Improving Data Reusability in Interactive Information Retrieval: Insights from the Community
by: Jiang, Tianji, et al.
Published: (2025)

LLMs Can Patch Up Missing Relevance Judgments in Evaluation
by: Upadhyay, Shivani, et al.
Published: (2024)

An Exam-based Evaluation Approach Beyond Traditional Relevance Judgments
by: Farzi, Naghmeh, et al.
Published: (2024)

Beyond Static Evaluation: Rethinking the Assessment of Personalized Agent Adaptability in Information Retrieval
by: Kaur, Kirandeep, et al.
Published: (2025)

Dynamic Evaluation Framework for Personalized and Trustworthy Agents: A Multi-Session Approach to Preference Adaptability
by: Shah, Chirag, et al.
Published: (2025)

Scaling Search Relevance: Augmenting App Store Ranking with LLM-Generated Judgments
by: Christakopoulou, Evangelia, et al.
Published: (2026)

Benchmarking LLM-based Relevance Judgment Methods
by: Arabzadeh, Negar, et al.
Published: (2025)

Estimating the Usefulness of Clarifying Questions and Answers for Conversational Search
by: Sekulić, Ivan, et al.
Published: (2024)

Judging with Personality and Confidence: A Study on Personality-Conditioned LLM Relevance Assessment
by: Chen, Nuo, et al.
Published: (2026)

Multimodal Item Scoring for Natural Language Recommendation via Gaussian Process Regression with LLM Relevance Judgments
by: Liu, Yifan, et al.
Published: (2025)

LLMJudge: LLMs for Relevance Judgments
by: Rahmani, Hossein A., et al.
Published: (2024)

Aligning Query Representation with Rewritten Query and Relevance Judgments in Conversational Search
by: Mo, Fengran, et al.
Published: (2024)

LiveNewsBench: Evaluating LLM Web Search Capabilities with Freshly Curated News
by: Zhang, Yunfan, et al.
Published: (2026)

DS@GT at LongEval: Evaluating Temporal Performance in Web Search Systems and Topics with Two-Stage Retrieval
by: Miyaguchi, Anthony, et al.
Published: (2025)

A Research Vision for Web Search on Emerging Topics
by: Rieger, Alisa, et al.
Published: (2025)

Efficient and Responsible Adaptation of Large Language Models for Robust and Equitable Top-k Recommendations
by: Kaur, Kirandeep, et al.
Published: (2025)

MS MARCO Web Search: a Large-scale Information-rich Web Dataset with Millions of Real Click Labels
by: Chen, Qi, et al.
Published: (2024)

On the Influence of Reading Sequences on Knowledge Gain during Web Search
by: Gritz, Wolfgang, et al.
Published: (2024)

WebRec: Enhancing LLM-based Recommendations with Attention-guided RAG from Web
by: Zhao, Zihuai, et al.
Published: (2025)

Augmenting Researchy Questions with Sub-question Judgments
by: Ju, Jia-Huei, et al.
Published: (2025)

Are Large Language Models Good at Utility Judgments?
by: Zhang, Hengran, et al.
Published: (2024)

Don't Use LLMs to Make Relevance Judgments
by: Soboroff, Ian
Published: (2024)

EcoGEO: Trajectory-Aware Evidence Ecosystems for Web-Enabled LLM Search Agents
by: Ye, Hengwei, et al.
Published: (2026)

Task Supportive and Personalized Human-Large Language Model Interaction: A User Study
by: Wang, Ben, et al.
Published: (2024)

Panmodal Information Interaction
by: Shah, Chirag, et al.
Published: (2024)