Cover Image

Accurate Knowledge Distillation with n-best Reranking

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Setiawan, Hendra
Format:	Preprint
Published:	2023
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Overcoming Vocabulary Constraints with Pixel-level Fallback
by: Lotz, Jonas F., et al.
Published: (2025)

Beyond Text Compression: Evaluating Tokenizers Across Scales
by: Lotz, Jonas F., et al.
Published: (2025)

Distillation versus Contrastive Learning: How to Train Your Rerankers
by: Xu, Zhichao, et al.
Published: (2025)

LLM Distillation for Efficient Few-Shot Multiple Choice Question Answering
by: Sutanto, Patrick, et al.
Published: (2024)

Multimodal Reranking for Knowledge-Intensive Visual Question Answering
by: Wen, Haoyang, et al.
Published: (2024)

MemReranker: Reasoning-Aware Reranking for Agent Memory Retrieval
by: Li, Chunyu, et al.
Published: (2026)

Knowledge-Aware Diverse Reranking for Cross-Source Question Answering
by: Zhou, Tong
Published: (2025)

DeAR: Dual-Stage Document Reranking with Reasoning Agents via LLM Distillation
by: Abdallah, Abdelrahman, et al.
Published: (2025)

Gumbel Reranking: Differentiable End-to-End Reranker Optimization
by: Huang, Siyuan, et al.
Published: (2025)

MLLM Is a Strong Reranker: Advancing Multimodal Retrieval-augmented Generation via Knowledge-enhanced Reranking and Noise-injected Training
by: Chen, Zhanpeng, et al.
Published: (2024)

Efficient Rationale-based Retrieval: On-policy Distillation from Generative Rerankers based on JEPA
by: Chen, Teng, et al.
Published: (2026)

Efficiency-Effectiveness Reranking FLOPs for LLM-based Rerankers
by: Peng, Zhiyuan, et al.
Published: (2025)

MemRerank: Preference Memory for Personalized Product Reranking
by: Peng, Zhiyuan, et al.
Published: (2026)

Embedding-Based Context-Aware Reranker
by: Yuan, Ye, et al.
Published: (2025)

Theoretical guarantees on the best-of-n alignment policy
by: Beirami, Ahmad, et al.
Published: (2024)

SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generated LLMs
by: Chen, Haotian, et al.
Published: (2025)

How Good are LLM-based Rerankers? An Empirical Analysis of State-of-the-Art Reranking Models
by: Abdallah, Abdelrahman, et al.
Published: (2025)

Rethinking Selective Knowledge Distillation
by: Tavor, Almog, et al.
Published: (2026)

Efficient Title Reranker for Fast and Improved Knowledge-Intense NLP
by: Chen, Ziyi, et al.
Published: (2023)

Reranking-based Generation for Unbiased Perspective Summarization
by: Ri, Narutatsu, et al.
Published: (2025)

Quality Estimation Reranking for Document-Level Translation
by: Mrozinski, Krzysztof, et al.
Published: (2025)

DistillLens: Symmetric Knowledge Distillation Through Logit Lens
by: Dhakal, Manish, et al.
Published: (2026)

QCG-Rerank: Chunks Graph Rerank with Query Expansion in Retrieval-Augmented LLMs for Tourism Domain
by: Wei, Qikai, et al.
Published: (2024)

Exploring Knowledge Purification in Multi-Teacher Knowledge Distillation for LLMs
by: Jin, Ruihan, et al.
Published: (2026)

LLM-Guided Knowledge Distillation for Temporal Knowledge Graph Reasoning
by: Xing, Wang, et al.
Published: (2026)

LLM Optimization Unlocks Real-Time Pairwise Reranking
by: Wu, Jingyu, et al.
Published: (2025)

Investigating Test-Time Scaling with Reranking for Machine Translation
by: Tan, Shaomu, et al.
Published: (2025)

A Bayesian Optimization Approach to Machine Translation Reranking
by: Cheng, Julius, et al.
Published: (2024)

Beyond Sequential Reranking: Reranker-Guided Search Improves Reasoning Intensive Retrieval
by: Xu, Haike, et al.
Published: (2025)

Building Consumer Loyalty: Understanding E-Satisfaction in Fast-Fashion Purchases on E-Commerce Platform
by: Wijaya, Hendra, et al.
Published: (2025)

To Distill or Not to Distill? On the Robustness of Robust Knowledge Distillation
by: Waheed, Abdul, et al.
Published: (2024)

Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models
by: Xing, Wang, et al.
Published: (2026)

Memorization Dynamics in Knowledge Distillation for Language Models
by: Borkar, Jaydeep, et al.
Published: (2026)

On the Generalization vs Fidelity Paradox in Knowledge Distillation
by: Ramesh, Suhas Kamasetty, et al.
Published: (2025)

Revisiting Knowledge Distillation for Autoregressive Language Models
by: Zhong, Qihuang, et al.
Published: (2024)

Reranker Optimization via Geodesic Distances on k-NN Manifolds
by: Gong, Wen G.
Published: (2026)

Query-focused and Memory-aware Reranker for Long Context Processing
by: Li, Yuqing, et al.
Published: (2026)

Warmup-Distill: Bridge the Distribution Mismatch between Teacher and Student before Knowledge Distillation
by: Sun, Zengkui, et al.
Published: (2025)

Knowledge Distillation with Training Wheels
by: Liu, Guanlin, et al.
Published: (2025)

State Space Models are Strong Text Rerankers
by: Xu, Zhichao, et al.
Published: (2024)