How role-play shapes relevance judgment in zero-shot LLM rankers
Fuente:
arXiv
Saved in:
| Main Authors: | Wang, Yumeng, Qi, Jirui, Chen, Catherine, Eustratiadis, Panagiotis, Verberne, Suzan |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
RankSteer: Activation Steering for Pointwise LLM Ranking
by: Wang, Yumeng, et al.
Published: (2026)
by: Wang, Yumeng, et al.
Published: (2026)
QUIDS: Query Intent Description for Exploratory Search via Dual Space Modeling
by: Wang, Yumeng, et al.
Published: (2024)
by: Wang, Yumeng, et al.
Published: (2024)
What are the limits of cross-lingual dense passage retrieval for low-resource languages?
by: Wu, Jie, et al.
Published: (2024)
by: Wu, Jie, et al.
Published: (2024)
On the Robustness of LLM-Based Dense Retrievers: A Systematic Analysis of Generalizability and Stability
by: Li, Yongkang, et al.
Published: (2026)
by: Li, Yongkang, et al.
Published: (2026)
Efficient course recommendations with T5-based ranking and summarization
by: Bijl, Thijmen, et al.
Published: (2024)
by: Bijl, Thijmen, et al.
Published: (2024)
Reproducing HotFlip for Corpus Poisoning Attacks in Dense Retrieval
by: Li, Yongkang, et al.
Published: (2025)
by: Li, Yongkang, et al.
Published: (2025)
LANCER: LLM Reranking for Nugget Coverage
by: Ju, Jia-Huei, et al.
Published: (2026)
by: Ju, Jia-Huei, et al.
Published: (2026)
Generative Reasoning Re-ranker
by: Liang, Mingfu, et al.
Published: (2026)
by: Liang, Mingfu, et al.
Published: (2026)
Answer Retrieval in Legal Community Question Answering
by: Askari, Arian, et al.
Published: (2024)
by: Askari, Arian, et al.
Published: (2024)
Unifying Search and Recommendation in LLMs via Gradient Multi-Subspace Tuning
by: Zhao, Jujia, et al.
Published: (2026)
by: Zhao, Jujia, et al.
Published: (2026)
Unifying Search and Recommendation with Dual-View Representation Learning in a Generative Paradigm
by: Zhao, Jujia, et al.
Published: (2025)
by: Zhao, Jujia, et al.
Published: (2025)
LUMI: Unsupervised Intent Clustering with Multiple Pseudo-Labels
by: Lin, I-Fan, et al.
Published: (2025)
by: Lin, I-Fan, et al.
Published: (2025)
Spectral Tempering for Embedding Compression in Dense Passage Retrieval
by: Li, Yongkang, et al.
Published: (2026)
by: Li, Yongkang, et al.
Published: (2026)
Hierarchical Re-ranker Retriever (HRR)
by: Singh, Ashish, et al.
Published: (2025)
by: Singh, Ashish, et al.
Published: (2025)
Unsupervised Corpus Poisoning Attacks in Continuous Space for Dense Retrieval
by: Li, Yongkang, et al.
Published: (2025)
by: Li, Yongkang, et al.
Published: (2025)
Improving RAG for Personalization with Author Features and Contrastive Examples
by: Yazan, Mert, et al.
Published: (2025)
by: Yazan, Mert, et al.
Published: (2025)
The Impact of Quantization on Retrieval-Augmented Generation: An Analysis of Small LLMs
by: Yazan, Mert, et al.
Published: (2024)
by: Yazan, Mert, et al.
Published: (2024)
Controlled Retrieval-augmented Context Evaluation for Long-form RAG
by: Ju, Jia-Huei, et al.
Published: (2025)
by: Ju, Jia-Huei, et al.
Published: (2025)
Search for Coverage: Learning Coverage-Aware Retrieval with Augmented Sub-Question Answerability
by: Ju, Jia-Huei, et al.
Published: (2026)
by: Ju, Jia-Huei, et al.
Published: (2026)
High Recall, Small Data: The Challenges of Within-System Evaluation in a Live Legal Search System
by: Wiggers, Gineke, et al.
Published: (2024)
by: Wiggers, Gineke, et al.
Published: (2024)
Information Leakage of Sentence Embeddings via Generative Embedding Inversion Attacks
by: Tragoudaras, Antonios, et al.
Published: (2025)
by: Tragoudaras, Antonios, et al.
Published: (2025)
Generative Retrieval with Few-shot Indexing
by: Askari, Arian, et al.
Published: (2024)
by: Askari, Arian, et al.
Published: (2024)
A Multi-Agent Conversational Recommender System
by: Fang, Jiabao, et al.
Published: (2024)
by: Fang, Jiabao, et al.
Published: (2024)
Agent-centric Information Access
by: Kanoulas, Evangelos, et al.
Published: (2025)
by: Kanoulas, Evangelos, et al.
Published: (2025)
FRESCO: Benchmarking and Optimizing Re-rankers for Evolving Semantic Conflict in Retrieval-Augmented Generation
by: An, Sohyun, et al.
Published: (2026)
by: An, Sohyun, et al.
Published: (2026)
Differentiable Semantic ID for Generative Recommendation
by: Fu, Junchen, et al.
Published: (2026)
by: Fu, Junchen, et al.
Published: (2026)
Exploring the Effectiveness of Multi-stage Fine-tuning for Cross-encoder Re-rankers
by: Pezzuti, Francesca, et al.
Published: (2025)
by: Pezzuti, Francesca, et al.
Published: (2025)
Revisiting Human-vs-LLM judgments using the TREC Podcast Track
by: Mansour, Watheq, et al.
Published: (2026)
by: Mansour, Watheq, et al.
Published: (2026)
Developing Visual Augmented Q&A System using Scalable Vision Embedding Retrieval & Late Interaction Re-ranker
by: Saxena, Rachna, et al.
Published: (2025)
by: Saxena, Rachna, et al.
Published: (2025)
LLM-based relevance assessment still can't replace human relevance assessment
by: Clarke, Charles L. A., et al.
Published: (2024)
by: Clarke, Charles L. A., et al.
Published: (2024)
An Investigation of Prompt Variations for Zero-shot LLM-based Rankers
by: Sun, Shuoqi, et al.
Published: (2024)
by: Sun, Shuoqi, et al.
Published: (2024)
Team LA at SCIDOCA shared task 2025: Citation Discovery via relation-based zero-shot retrieval
by: An, Trieu, et al.
Published: (2025)
by: An, Trieu, et al.
Published: (2025)
A Plug-and-play Model-agnostic Embedding Enhancement Approach for Explainable Recommendation
by: Mi, Yunqi, et al.
Published: (2025)
by: Mi, Yunqi, et al.
Published: (2025)
Graph Stochastic Neural Process for Inductive Few-shot Knowledge Graph Completion
by: Zhao, Zicheng, et al.
Published: (2024)
by: Zhao, Zicheng, et al.
Published: (2024)
Does LLM Focus on the Right Words? Mitigating Context Bias in LLM-based Recommenders
by: Wang, Bohao, et al.
Published: (2025)
by: Wang, Bohao, et al.
Published: (2025)
Pathway to Relevance: How Cross-Encoders Implement a Semantic Variant of BM25
by: Lu, Meng, et al.
Published: (2025)
by: Lu, Meng, et al.
Published: (2025)
Beyond Reproducibility: Advancing Zero-shot LLM Reranking Efficiency with Setwise Insertion
by: Podolak, Jakub, et al.
Published: (2025)
by: Podolak, Jakub, et al.
Published: (2025)
A Pre-trained Sequential Recommendation Framework: Popularity Dynamics for Zero-shot Transfer
by: Wang, Junting, et al.
Published: (2024)
by: Wang, Junting, et al.
Published: (2024)
Turning Semantics into Topology: LLM-Driven Attribute Augmentation for Collaborative Filtering
by: Meng, Junjie, et al.
Published: (2026)
by: Meng, Junjie, et al.
Published: (2026)
TagLLM: A Fine-Grained Tag Generation Approach for Note Recommendation
by: Chen, Zhijian, et al.
Published: (2026)
by: Chen, Zhijian, et al.
Published: (2026)
Similar Items
-
RankSteer: Activation Steering for Pointwise LLM Ranking
by: Wang, Yumeng, et al.
Published: (2026) -
QUIDS: Query Intent Description for Exploratory Search via Dual Space Modeling
by: Wang, Yumeng, et al.
Published: (2024) -
What are the limits of cross-lingual dense passage retrieval for low-resource languages?
by: Wu, Jie, et al.
Published: (2024) -
On the Robustness of LLM-Based Dense Retrievers: A Systematic Analysis of Generalizability and Stability
by: Li, Yongkang, et al.
Published: (2026) -
Efficient course recommendations with T5-based ranking and summarization
by: Bijl, Thijmen, et al.
Published: (2024)