Evaluating Cost-Accuracy Trade-offs in Multimodal Search Relevance Judgements

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Terragni, Silvia, Cuong, Hoang, Daiber, Joachim, Gudipati, Pallavi, Mendes, Pablo N.
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computation and Language Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Ensembles at Any Cost? Accuracy-Energy Trade-offs in Recommender Systems
by: Nitschke, Jannik, et al.
Published: (2026)

Judgement Citation Retrieval using Contextual Similarity
by: Dasula, Akshat Mohan, et al.
Published: (2024)

The Structure-Content Trade-off in Knowledge Graph Retrieval
by: Six, Valentin, et al.
Published: (2025)

Meta-Learning and Targeted Differential Privacy to Improve the Accuracy-Privacy Trade-off in Recommendations
by: Müllner, Peter, et al.
Published: (2026)

LORE: A Large Generative Model for Search Relevance
by: Lu, Chenji, et al.
Published: (2025)

FlashEvaluator: Expanding Search Space with Parallel Evaluation
by: Feng, Chao, et al.
Published: (2026)

To Judge or not to Judge: Using LLM Judgements for Advertiser Keyphrase Relevance at eBay
by: Dey, Soumik, et al.
Published: (2025)

Optimizing Multi-Stage Language Models for Effective Text Retrieval
by: Trung, Quang Hoang, et al.
Published: (2024)

LLM-based Relevance Assessment for Web-Scale Search Evaluation at Pinterest
by: Wang, Han, et al.
Published: (2025)

Rethinking Legal Judgement Prediction in a Realistic Scenario in the Era of Large Language Models
by: Nigam, Shubham Kumar, et al.
Published: (2024)

Search Arena: Analyzing Search-Augmented LLMs
by: Miroyan, Mihran, et al.
Published: (2025)

The Efficiency vs. Accuracy Trade-off: Optimizing RAG-Enhanced LLM Recommender Systems Using Multi-Head Early Exit
by: Zhou, Huixue, et al.
Published: (2025)

CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search
by: Wu, Kaixin, et al.
Published: (2024)

Automated Query-Product Relevance Labeling using Large Language Models for E-commerce Search
by: Sachdev, Jayant, et al.
Published: (2025)

LiveNewsBench: Evaluating LLM Web Search Capabilities with Freshly Curated News
by: Zhang, Yunfan, et al.
Published: (2026)

Adaptive Two-Phase Finetuning LLMs for Japanese Legal Text Retrieval
by: Trung, Quang Hoang, et al.
Published: (2024)

How do Large Language Models Understand Relevance? A Mechanistic Interpretability Perspective
by: Liu, Qi, et al.
Published: (2025)

Beyond Contrastive Learning: Synthetic Data Enables List-wise Training with Multiple Levels of Relevance
by: Esfandiarpoor, Reza, et al.
Published: (2025)

Explainable Disentangled Representation Learning for Generalizable Authorship Attribution in the Era of Generative AI
by: Man, Hieu, et al.
Published: (2026)

Open Deep Search: Democratizing Search with Open-source Reasoning Agents
by: Alzubi, Salaheddin, et al.
Published: (2025)

From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents
by: Zhang, Weizhi, et al.
Published: (2025)

Relevance Isn't All You Need: Scaling RAG Systems With Inference-Time Compute Via Multi-Criteria Reranking
by: LeVine, Will, et al.
Published: (2025)

Bayesian Active Learning for Multi-Criteria Comparative Judgement in Educational Assessment
by: Gray, Andy, et al.
Published: (2025)

Key Information Retrieval to Classify the Unstructured Data Content of Preferential Trade Agreements
by: Zhao, Jiahui, et al.
Published: (2024)

Pseudo Label NCF for Sparse OHC Recommendation: Dual Representation Learning and the Separability Accuracy Trade off
by: Barman, Pronob Kumar, et al.
Published: (2026)

Mine and Refine: Optimizing Graded Relevance in E-commerce Search Retrieval
by: Xi, Jiaqi, et al.
Published: (2026)

Do Recommender Systems Really Leverage Multimodal Content? A Comprehensive Analysis on Multimodal Representations for Recommendation
by: Pomo, Claudio, et al.
Published: (2025)

Content Moderation in TV Search: Balancing Policy Compliance, Relevance, and User Experience
by: Hande, Adeep, et al.
Published: (2025)

Microstructures and Accuracy of Graph Recall by Large Language Models
by: Wang, Yanbang, et al.
Published: (2024)

Adaptive Quality-Diversity Trade-offs for Large-Scale Batch Recommendation
by: Réda, Clémence, et al.
Published: (2026)

Beyond Sequential Reranking: Reranker-Guided Search Improves Reasoning Intensive Retrieval
by: Xu, Haike, et al.
Published: (2025)

Test-Time Compute for Frozen Embedding Models through Agentic Program Search
by: Xiao, Han
Published: (2026)

Beyond Relevance: Utility-Centric Retrieval in the LLM Era
by: Zhang, Hengran, et al.
Published: (2026)

Description Boosting for Zero-Shot Entity and Relation Classification
by: Picco, Gabriele, et al.
Published: (2024)

Search-P1: Path-Centric Reward Shaping for Stable and Efficient Agentic RAG Training
by: Xia, Tianle, et al.
Published: (2026)

Zero-Shot Dense Retrieval with Embeddings from Relevance Feedback
by: Jedidi, Nour, et al.
Published: (2024)

Knowledge Distillation for Enhancing Walmart E-commerce Search Relevance Using Large Language Models
by: Shang, Hongwei, et al.
Published: (2025)

PaperSearchQA: Learning to Search and Reason over Scientific Papers with RLVR
by: Burgess, James, et al.
Published: (2026)

An Iterative Utility Judgment Framework Inspired by Philosophical Relevance via LLMs
by: Zhang, Hengran, et al.
Published: (2024)

NLP-Powered Repository and Search Engine for Academic Papers: A Case Study on Cyber Risk Literature with CyLit
by: Zhang, Linfeng, et al.
Published: (2024)