Best Practices for Distilling Large Language Models into BERT for Web Search Ranking

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ye, Dezhi, Hu, Junwei, Fan, Jiabin, Tian, Bowen, Liu, Jie, Liang, Haijin, Ma, Jin
Format:	Preprint
Published:	2024
Subjects:	Information Retrieval Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

TFRank: Think-Free Reasoning Enables Practical Pointwise LLM Ranking
by: Fan, Yongqi, et al.
Published: (2025)

Rank4Gen: RAG-Preference-Aligned Document Set Selection and Ranking
by: Fan, Yongqi, et al.
Published: (2026)

Is ChatGPT Good at Search? Investigating Large Language Models as Re-Ranking Agents
by: Sun, Weiwei, et al.
Published: (2023)

CoRank: LLM-Based Compact Reranking with Document Features for Scientific Retrieval
by: Tian, Runchu, et al.
Published: (2025)

BASES: Large-scale Web Search User Simulation with Large Language Model based Agents
by: Ren, Ruiyang, et al.
Published: (2024)

RAG-Enhanced Large Language Models for Dynamic Content Expiration Prediction in Web Search
by: Chen, Tingyu, et al.
Published: (2026)

Generative Multi-Modal Knowledge Retrieval with Large Language Models
by: Long, Xinwei, et al.
Published: (2024)

Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Models
by: Salemi, Alireza, et al.
Published: (2024)

CoRanking: Collaborative Ranking with Small and Large Ranking Agents
by: Liu, Wenhan, et al.
Published: (2025)

TourRank: Utilizing Large Language Models for Documents Ranking with a Tournament-Inspired Strategy
by: Chen, Yiqun, et al.
Published: (2024)

Does Knowledge Distillation Matter for Large Language Model based Bundle Generation?
by: Feng, Kaidong, et al.
Published: (2025)

WeKnow-RAG: An Adaptive Approach for Retrieval-Augmented Generation Integrating Web Search and Knowledge Graphs
by: Xie, Weijian, et al.
Published: (2024)

DemoRank: Selecting Effective Demonstrations for Large Language Models in Ranking Task
by: Liu, Wenhan, et al.
Published: (2024)

Sliding Windows Are Not the End: Exploring Full Ranking with Long-Context Large Language Models
by: Liu, Wenhan, et al.
Published: (2024)

SD-Search: On-Policy Hindsight Self-Distillation for Search-Augmented Reasoning
by: Ma, Yufei, et al.
Published: (2026)

Large Language Models as Evaluators for Recommendation Explanations
by: Zhang, Xiaoyu, et al.
Published: (2024)

Search-E1: Self-Distillation Drives Self-Evolution in Search-Augmented Reasoning
by: Liang, Zihan, et al.
Published: (2026)

Re-Ranking Step by Step: Investigating Pre-Filtering for Re-Ranking with Large Language Models
by: Nouriinanloo, Baharan, et al.
Published: (2024)

A Survey of Generative Search and Recommendation in the Era of Large Language Models
by: Li, Yongqi, et al.
Published: (2024)

Routing Distilled Knowledge via Mixture of LoRA Experts for Large Language Model based Bundle Generation
by: Feng, Kaidong, et al.
Published: (2025)

MiLQ: Benchmarking IR Models for Bilingual Web Search with Mixed Language Queries
by: Kim, Jonghwi, et al.
Published: (2025)

Large Search Model: Redefining Search Stack in the Era of LLMs
by: Wang, Liang, et al.
Published: (2023)

A Comprehensive Evaluation of Large Language Models on Temporal Event Forecasting
by: Chang, He, et al.
Published: (2024)

ColBERT-Zero: To Pre-train Or Not To Pre-train ColBERT models
by: Chaffin, Antoine, et al.
Published: (2026)

Extending Translate-Train for ColBERT-X to African Language CLIR
by: Yang, Eugene, et al.
Published: (2024)

Leveraging Generative Models for Real-Time Query-Driven Text Summarization in Large-Scale Web Search
by: Xiong, Zeyu, et al.
Published: (2025)

Multi-Layer Ranking with Large Language Models for News Source Recommendation
by: Zhang, Wenjia, et al.
Published: (2024)

ColBERT Retrieval and Ensemble Response Scoring for Language Model Question Answering
by: Gichamba, Alex, et al.
Published: (2024)

Demystifying and Enhancing the Efficiency of Large Language Model Based Search Agents
by: Yang, Tiannuo, et al.
Published: (2025)

SLMRec: Distilling Large Language Models into Small for Sequential Recommendation
by: Xu, Wujiang, et al.
Published: (2024)

Improving Pinterest Search Relevance Using Large Language Models
by: Wang, Han, et al.
Published: (2024)

Do Large Language Models Rank Fairly? An Empirical Study on the Fairness of LLMs as Rankers
by: Wang, Yuan, et al.
Published: (2024)

Large Language Models Require Curated Context for Reliable Political Fact-Checking -- Even with Reasoning and Web Search
by: DeVerna, Matthew R., et al.
Published: (2025)

Ontology Matching with Large Language Models and Prioritized Depth-First Search
by: Taboada, Maria, et al.
Published: (2025)

INTERS: Unlocking the Power of Large Language Models in Search with Instruction Tuning
by: Zhu, Yutao, et al.
Published: (2024)

Translate-Distill: Learning Cross-Language Dense Retrieval by Translation and Distillation
by: Yang, Eugene, et al.
Published: (2024)

LLM4Ranking: An Easy-to-use Framework of Utilizing Large Language Models for Document Reranking
by: Liu, Qi, et al.
Published: (2025)

Exploring the Best Practices of Query Expansion with Large Language Models
by: Zhang, Le, et al.
Published: (2024)

Controlling Output Rankings in Generative Engines for LLM-based Search
by: Jin, Haibo, et al.
Published: (2026)

Orthogonal Hierarchical Decomposition for Structure-Aware Table Understanding with Large Language Models
by: Cao, Bin, et al.
Published: (2026)