LLM-based Relevance Assessment for Web-Scale Search Evaluation at Pinterest

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Han, Whitworth, Alex, Cheung, Pak Ming, Zhang, Zhenjie, Kamath, Krishna
Format:	Preprint
Published:	2025
Subjects:	Information Retrieval Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Improving Pinterest Search Relevance Using Large Language Models
by: Wang, Han, et al.
Published: (2024)

UniPinRec: Unifying Generative Retrieval and Ranking at Pinterest Scale
by: Li, Hanyu, et al.
Published: (2026)

Scaling Search Relevance: Augmenting App Store Ranking with LLM-Generated Judgments
by: Christakopoulou, Evangelia, et al.
Published: (2026)

Decoupled Entity Representation Learning for Pinterest Ads Ranking
by: Liu, Jie, et al.
Published: (2025)

Warmer for Less: A Cost-Efficient Strategy for Cold-Start Recommendations at Pinterest
by: Ebrahimi, Saeed, et al.
Published: (2025)

Multi-Faceted Large Embedding Tables for Pinterest Ads Ranking
by: Su, Runze, et al.
Published: (2025)

A Production-Ready RL Framework for Personalized Utility Tuning with Pareto Sweeping in Pinterest Recommender Systems
by: Zhou, Yichu, et al.
Published: (2026)

LiveNewsBench: Evaluating LLM Web Search Capabilities with Freshly Curated News
by: Zhang, Yunfan, et al.
Published: (2026)

OmniSearchSage: Multi-Task Multi-Entity Embeddings for Pinterest Search
by: Agarwal, Prabhat, et al.
Published: (2024)

Pre-trained Graphformer-based Ranking at Web-scale Search (Extended Abstract)
by: Li, Yuchen, et al.
Published: (2024)

Mine and Refine: Optimizing Graded Relevance in E-commerce Search Retrieval
by: Xi, Jiaqi, et al.
Published: (2026)

Powering Job Search at Scale: LLM-Enhanced Query Understanding in Job Matching Systems
by: Liu, Ping, et al.
Published: (2025)

Evaluating Cost-Accuracy Trade-offs in Multimodal Search Relevance Judgements
by: Terragni, Silvia, et al.
Published: (2024)

Knowledge Distillation for Enhancing Walmart E-commerce Search Relevance Using Large Language Models
by: Shang, Hongwei, et al.
Published: (2025)

Content Moderation in TV Search: Balancing Policy Compliance, Relevance, and User Experience
by: Hande, Adeep, et al.
Published: (2025)

CPRM: A LLM-based Continual Pre-training Framework for Relevance Modeling in Commercial Search
by: Wu, Kaixin, et al.
Published: (2024)

LLM-VPRF: Large Language Model Based Vector Pseudo Relevance Feedback
by: Li, Hang, et al.
Published: (2025)

Unified Embedding: Battle-Tested Feature Representations for Web-Scale ML Systems
by: Coleman, Benjamin, et al.
Published: (2023)

From Web Search towards Agentic Deep Research: Incentivizing Search with Reasoning Agents
by: Zhang, Weizhi, et al.
Published: (2025)

PaSa: An LLM Agent for Comprehensive Academic Paper Search
by: He, Yichen, et al.
Published: (2025)

Generative Pre-trained Ranking Model with Over-parameterization at Web-Scale (Extended Abstract)
by: Li, Yuchen, et al.
Published: (2024)

Off-policy Evaluation for Payments at Adyen
by: Egg, Alex
Published: (2025)

Scaling Up LLM Reviews for Google Ads Content Moderation
by: Qiao, Wei, et al.
Published: (2024)

Joint Model Parameter Scaling and Universal-Domain Data Integration for E-commerce Search Ranking
by: Yu, Liren, et al.
Published: (2026)

Rethinking Deep Research from the Perspective of Web Content Distribution Matching
by: Yu, Zixuan, et al.
Published: (2026)

Boosting LLM-based Relevance Modeling with Distribution-Aware Robust Learning
by: Liu, Hong, et al.
Published: (2024)

Tree-based Focused Web Crawling with Reinforcement Learning
by: Kontogiannis, Andreas, et al.
Published: (2021)

Scaling Up Efficient Small Language Models Serving and Deployment for Semantic Job Search
by: Behdin, Kayhan, et al.
Published: (2025)

Break the ID-Language Barrier: An Adaption Framework for LLM-based Sequential Recommendation
by: Yu, Xiaohan, et al.
Published: (2024)

A Unified Language Model for Large Scale Search, Recommendation, and Reasoning
by: De Nadai, Marco, et al.
Published: (2026)

LLM-guided Hierarchical Search for End-to-end Reasoning Intensive Retrieval
by: Gupta, Nilesh, et al.
Published: (2025)

FlashEvaluator: Expanding Search Space with Parallel Evaluation
by: Feng, Chao, et al.
Published: (2026)

DistDNAS: Search Efficient Feature Interactions within 2 Hours
by: Zhang, Tunhou, et al.
Published: (2023)

asLLR: LLM based Leads Ranking in Auto Sales
by: Sun, Yin, et al.
Published: (2025)

MoToRec: Sparse-Regularized Multimodal Tokenization for Cold-Start Recommendation
by: Liu, Jialin, et al.
Published: (2026)

Design and Evaluation of Whole-Page Experience Optimization for E-commerce Search
by: Lahiri, Pratik, et al.
Published: (2026)

Pseudo Relevance Feedback is Enough to Close the Gap Between Small and Large Dense Retrieval Models
by: Li, Hang, et al.
Published: (2025)

Generating Query-Relevant Document Summaries via Reinforcement Learning
by: Yadav, Nitin, et al.
Published: (2025)

Dynamic User Interest Augmentation via Stream Clustering and Memory Networks in Large-Scale Recommender Systems
by: Liu, Peng, et al.
Published: (2024)

LORE: A Large Generative Model for Search Relevance
by: Lu, Chenji, et al.
Published: (2025)