Cover Image

Distillation and Refinement of Reasoning in Small Language Models for Document Re-ranking

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Samarinas, Chris, Zamani, Hamed
Format:	Preprint
Published:	2025
Subjects:	Information Retrieval Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Plan-and-Refine: Diverse and Comprehensive Retrieval-Augmented Generation
by: Salemi, Alireza, et al.
Published: (2025)

Truncated Step-Level Sampling with Process Rewards for Retrieval-Augmented Reasoning
by: Samarinas, Chris, et al.
Published: (2026)

ProCIS: A Benchmark for Proactive Retrieval in Conversations
by: Samarinas, Chris, et al.
Published: (2024)

Towards a Search Engine for Machines: Unified Ranking for Multiple Retrieval-Augmented Large Language Models
by: Salemi, Alireza, et al.
Published: (2024)

Optimization Methods for Personalizing Large Language Models through Retrieval Augmentation
by: Salemi, Alireza, et al.
Published: (2024)

Learning to Rank for Multiple Retrieval-Augmented Models through Iterative Utility Maximization
by: Salemi, Alireza, et al.
Published: (2024)

Evaluating Retrieval Quality in Retrieval-Augmented Generation
by: Salemi, Alireza, et al.
Published: (2024)

Learning from Natural Language Feedback for Personalized Question Answering
by: Salemi, Alireza, et al.
Published: (2025)

Benchmarking Information Retrieval Models on Complex Retrieval Tasks
by: Killingback, Julian, et al.
Published: (2025)

CoSearch: Joint Training of Reasoning and Document Ranking via Reinforcement Learning for Agentic Search
by: Zeng, Hansi, et al.
Published: (2026)

Learning to Reason for Multi-Step Retrieval of Personal Context in Personalized Question Answering
by: Amirizaniani, Maryam, et al.
Published: (2026)

REARANK: Reasoning Re-ranking Agent via Reinforcement Learning
by: Zhang, Le, et al.
Published: (2025)

CIIR@LiveRAG 2025: Optimizing Multi-Agent Retrieval Augmented Generation through Self-Training
by: Salemi, Alireza, et al.
Published: (2025)

Planning Ahead in Generative Retrieval: Guiding Autoregressive Generation through Simultaneous Decoding
by: Zeng, Hansi, et al.
Published: (2024)

LaMP-QA: A Benchmark for Personalized Long-form Question Answering
by: Salemi, Alireza, et al.
Published: (2025)

Stochastic RAG: End-to-End Retrieval-Augmented Generation through Expected Utility Maximization
by: Zamani, Hamed, et al.
Published: (2024)

Inferential Question Answering
by: Mozafari, Jamshid, et al.
Published: (2026)

ExPerT: Effective and Explainable Evaluation of Personalized Long-Form Text Generation
by: Salemi, Alireza, et al.
Published: (2025)

Multi-stage Retrieve and Re-rank Model for Automatic Medical Coding Recommendation
by: Wang, Xindi, et al.
Published: (2024)

Improving User Privacy in Personalized Generation: Client-Side Retrieval-Augmented Modification of Server-Side Generated Speculations
by: Salemi, Alireza, et al.
Published: (2026)

DeAR: Dual-Stage Document Reranking with Reasoning Agents via LLM Distillation
by: Abdallah, Abdelrahman, et al.
Published: (2025)

SLMRec: Distilling Large Language Models into Small for Sequential Recommendation
by: Xu, Wujiang, et al.
Published: (2024)

Learning to Route Queries to Heads for Attention-based Re-ranking with Large Language Models
by: Tian, Yuxing, et al.
Published: (2026)

Bridging Personalization and Control in Scientific Personalized Search
by: Mysore, Sheshera, et al.
Published: (2024)

DocReLM: Mastering Document Retrieval with Language Model
by: Wei, Gengchen, et al.
Published: (2024)

Chunking, Retrieval, and Re-ranking: An Empirical Evaluation of RAG Architectures for Policy Document Question Answering
by: Maharjan, Anuj, et al.
Published: (2026)

GIER: Gap-Driven Self-Refinement for Large Language Models
by: Dewri, Rinku
Published: (2025)

Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learning
by: Jin, Bowen, et al.
Published: (2025)

Re-Ranking Step by Step: Investigating Pre-Filtering for Re-Ranking with Large Language Models
by: Nouriinanloo, Baharan, et al.
Published: (2024)

Can Small Language Models be Good Reasoners for Sequential Recommendation?
by: Wang, Yuling, et al.
Published: (2024)

ReFineG: Synergizing Small Supervised Models and LLMs for Low-Resource Grounded Multimodal NER
by: Tang, Jielong, et al.
Published: (2025)

Reasoning-Enhanced Self-Training for Long-Form Personalized Text Generation
by: Salemi, Alireza, et al.
Published: (2025)

Query Optimization for Parametric Knowledge Refinement in Retrieval-Augmented Large Language Models
by: Cong, Youan, et al.
Published: (2024)

Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning
by: Badhe, Sanket, et al.
Published: (2026)

Translate-Distill: Learning Cross-Language Dense Retrieval by Translation and Distillation
by: Yang, Eugene, et al.
Published: (2024)

QDER: Query-Specific Document and Entity Representations for Multi-Vector Document Re-Ranking
by: Chatterjee, Shubham, et al.
Published: (2025)

Retrieval-Enhanced Machine Learning: Synthesis and Opportunities
by: Kim, To Eun, et al.
Published: (2024)

Interactive Topic Models with Optimal Transport
by: Dhanania, Garima, et al.
Published: (2024)

Hybrid Student-Teacher Large Language Model Refinement for Cancer Toxicity Symptom Extraction
by: Khanmohammadi, Reza, et al.
Published: (2024)

Does Knowledge Distillation Matter for Large Language Model based Bundle Generation?
by: Feng, Kaidong, et al.
Published: (2025)