Cover Image

Beyond Yes and No: Improving Zero-Shot LLM Rankers via Scoring Fine-Grained Relevance Labels

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhuang, Honglei, Qin, Zhen, Hui, Kai, Wu, Junru, Yan, Le, Wang, Xuanhui, Bendersky, Michael
Format:	Preprint
Published:	2023
Subjects:	Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Can Query Expansion Improve Generalization of Strong Cross-Encoder Rankers?
by: Li, Minghan, et al.
Published: (2023)

Large Language Models are Effective Text Rankers with Pairwise Ranking Prompting
by: Qin, Zhen, et al.
Published: (2023)

Consolidating Ranking and Relevance Predictions of Large Language Models through Post-Processing
by: Yan, Le, et al.
Published: (2024)

MCRanker: Generating Diverse Criteria On-the-Fly to Improve Point-wise LLM Rankers
by: Guo, Fang, et al.
Published: (2024)

Harnessing Pairwise Ranking Prompting Through Sample-Efficient Ranking Distillation
by: Wu, Junru, et al.
Published: (2025)

Reliable Confidence Intervals for Information Retrieval Evaluation Using Generative A.I
by: Oosterhuis, Harrie, et al.
Published: (2024)

An Investigation of Prompt Variations for Zero-shot LLM-based Rankers
by: Sun, Shuoqi, et al.
Published: (2024)

Searching Personal Collections
by: Bendersky, Michael, et al.
Published: (2024)

InRanker: Distilled Rankers for Zero-shot Information Retrieval
by: Laitz, Thiago, et al.
Published: (2024)

Large Language Models are Zero-Shot Rankers for Recommender Systems
by: Hou, Yupeng, et al.
Published: (2023)

LRanker: LLM Ranker for Massive Candidates
by: Feng, Tao, et al.
Published: (2026)

R1-Ranker: Teaching LLM Rankers to Reason
by: Feng, Tao, et al.
Published: (2025)

Attention in Large Language Models Yields Efficient Zero-Shot Re-Rankers
by: Chen, Shijie, et al.
Published: (2024)

Re-Rankers as Relevance Judges
by: Meng, Chuan, et al.
Published: (2026)

AutoMIR: Effective Zero-Shot Medical Information Retrieval without Relevance Labels
by: Li, Lei, et al.
Published: (2024)

LLM as Explainable Re-Ranker for Recommendation System
by: Wang, Yaqi, et al.
Published: (2025)

A Setwise Approach for Effective and Highly Efficient Zero-shot Ranking with Large Language Models
by: Zhuang, Shengyao, et al.
Published: (2023)

Rankers, Judges, and Assistants: Towards Understanding the Interplay of LLMs in Information Retrieval Evaluation
by: Balog, Krisztian, et al.
Published: (2025)

Beyond Relevance: Improving User Engagement by Personalization for Short-Video Search
by: Bao, Wentian, et al.
Published: (2024)

Where Relevance Emerges: A Layer-Wise Study of Internal Attention for Zero-Shot Re-Ranking
by: Chen, Haodong, et al.
Published: (2026)

RecRanker: Instruction Tuning Large Language Model as Ranker for Top-k Recommendation
by: Luo, Sichun, et al.
Published: (2023)

Guiding Retrieval using LLM-based Listwise Rankers
by: Rathee, Mandeep, et al.
Published: (2025)

Validating LLM-Generated Relevance Labels for Educational Resource Search
by: Sebastian, Ratan J., et al.
Published: (2025)

Multi-Label Zero-Shot Product Attribute-Value Extraction
by: Gong, Jiaying, et al.
Published: (2024)

Evaluating the Explainability of Neural Rankers
by: Pandian, Saran, et al.
Published: (2024)

Leveraging Reference Documents for Zero-Shot Ranking via Large Language Models
by: Li, Jieran, et al.
Published: (2025)

When LLM Judges Inflate Scores: Exploring Overrating in Relevance Assessment
by: Yu, Chuting, et al.
Published: (2026)

Optimizing Compound Retrieval Systems
by: Oosterhuis, Harrie, et al.
Published: (2025)

Multimodal Item Scoring for Natural Language Recommendation via Gaussian Process Regression with LLM Relevance Judgments
by: Liu, Yifan, et al.
Published: (2025)

Prism-Reranker: Beyond Relevance Scoring -- Jointly Producing Contributions and Evidence for Agentic Retrieval
by: Zhang, Dun
Published: (2026)

Team IELAB at TREC Clinical Trial Track 2023: Enhancing Clinical Trial Retrieval with Neural Rankers and Large Language Models
by: Zhuang, Shengyao, et al.
Published: (2024)

Retrieval Augmented Conversational Recommendation with Reinforcement Learning
by: Yue, Zhenrui, et al.
Published: (2026)

RecRankerEval: A Flexible and Extensible Framework for Top-k LLM-based Recommendation
by: Meng, Zeyuan, et al.
Published: (2025)

Batched Self-Consistency Improves LLM Relevance Assessment and Ranking
by: Korikov, Anton, et al.
Published: (2025)

Beyond Relevance: Evaluate and Improve Retrievers on Perspective Awareness
by: Zhao, Xinran, et al.
Published: (2024)

Beyond Single Labels: Improving Conversational Recommendation through LLM-Powered Data Augmentation
by: Xu, Haozhe, et al.
Published: (2025)

FGR-ColBERT: Identifying Fine-Grained Relevance Tokens During Retrieval
by: Jarolím, Antonín, et al.
Published: (2026)

Beyond Content Relevance: Evaluating Instruction Following in Retrieval Models
by: Zhou, Jianqun, et al.
Published: (2024)

Zero-Shot Dense Retrieval with Embeddings from Relevance Feedback
by: Jedidi, Nour, et al.
Published: (2024)

Likert or Not: LLM Absolute Relevance Judgments on Fine-Grained Ordinal Scales
by: Godfrey, Charles, et al.
Published: (2025)