Cover Image

Online Knowledge Distillation with Reward Guidance

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Jia, Chen
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Online Adversarial Knowledge Distillation for Graph Neural Networks
by: Wang, Can, et al.
Published: (2021)

Beyond Mimicry to Contextual Guidance: Knowledge Distillation for Interactive AI
by: Wang, Tong, et al.
Published: (2024)

Diversity-Rewarded CFG Distillation
by: Cideron, Geoffrey, et al.
Published: (2024)

Variance-aware Reward Modeling with Anchor Guidance
by: Fang, Shuxing, et al.
Published: (2026)

Rethinking Momentum Knowledge Distillation in Online Continual Learning
by: Michel, Nicolas, et al.
Published: (2023)

TGDPO: Harnessing Token-Level Reward Guidance for Enhancing Direct Preference Optimization
by: Zhu, Mingkang, et al.
Published: (2025)

Planning-Augmented Sampling with Early Guidance for High-Reward Discovery
by: Zhu, Rui, et al.
Published: (2025)

Group Relative Knowledge Distillation: Learning from Teacher's Relational Inductive Bias
by: Li, Chao, et al.
Published: (2025)

Dual-Granularity Contrastive Reward via Generated Episodic Guidance for Efficient Embodied RL
by: Liu, Xin, et al.
Published: (2026)

Beyond the Proxy: Trajectory-Distilled Guidance for Offline GFlowNet Training
by: Chen, Ruishuo, et al.
Published: (2025)

Distill to Delete: Unlearning in Graph Networks with Knowledge Distillation
by: Sinha, Yash, et al.
Published: (2023)

DLink: Distilling Layer-wise and Dominant Knowledge from EEG Foundation Models
by: Wang, Jingyuan, et al.
Published: (2026)

Generalizing Reward Modeling for Out-of-Distribution Preference Learning
by: Jia, Chen
Published: (2024)

Eliminating Inductive Bias in Reward Models with Information-Theoretic Guidance
by: Li, Zhuo, et al.
Published: (2025)

Reward Guidance for Reinforcement Learning Tasks Based on Large Language Models: The LMGT Framework
by: Deng, Yongxin, et al.
Published: (2024)

Instance Temperature Knowledge Distillation
by: Zhang, Zhengbo, et al.
Published: (2024)

ORSO: Accelerating Reward Design via Online Reward Selection and Policy Optimization
by: Zhang, Chen Bo Calvin, et al.
Published: (2024)

Knowledge Distillation Under Ideal Joint Classifier Assumption
by: Li, Huayu, et al.
Published: (2023)

From Novelty to Imitation: Self-Distilled Rewards for Offline Reinforcement Learning
by: Chaudhary, Gaurav, et al.
Published: (2025)

Power Distribution Bridges Sampling, Self-Reward RL, and Self-Distillation
by: Tomihari, Akiyoshi, et al.
Published: (2026)

Adversarial Curriculum Graph-Free Knowledge Distillation for Graph Neural Networks
by: Jia, Yuang, et al.
Published: (2025)

RFG: Test-Time Scaling for Diffusion Large Language Model Reasoning with Reward-Free Guidance
by: Chen, Tianlang, et al.
Published: (2025)

Reward-free World Models for Online Imitation Learning
by: Li, Shangzhe, et al.
Published: (2024)

Reward Weighted Classifier-Free Guidance as Policy Improvement in Autoregressive Models
by: Peysakhovich, Alexander, et al.
Published: (2026)

Lookahead Sample Reward Guidance for Test-Time Scaling of Diffusion Models
by: Kim, Yeongmin, et al.
Published: (2026)

Robust Preference Optimization through Reward Model Distillation
by: Fisch, Adam, et al.
Published: (2024)

Distilled Circuits: A Mechanistic Study of Internal Restructuring in Knowledge Distillation
by: Haskins, Reilly, et al.
Published: (2025)

Adversarial Moment-Matching Distillation of Large Language Models
by: Jia, Chen
Published: (2024)

ShiftKD: Benchmarking Knowledge Distillation under Distribution Shift
by: Zhang, Songming, et al.
Published: (2023)

Bridging the Gap: Unpacking the Hidden Challenges in Knowledge Distillation for Online Ranking Systems
by: Khani, Nikhil, et al.
Published: (2024)

How Is Uncertainty Propagated in Knowledge Distillation?
by: Cui, Ziyao, et al.
Published: (2026)

Knowledge Distillation with Adapted Weight
by: Wu, Sirong, et al.
Published: (2025)

Tailored Federated Learning: Leveraging Direction Regulation & Knowledge Distillation
by: Tang, Huidong, et al.
Published: (2024)

Provably Efficient Online RLHF with One-Pass Reward Modeling
by: Li, Long-Fei, et al.
Published: (2025)

How to Backdoor the Knowledge Distillation
by: Wu, Chen, et al.
Published: (2025)

Less or More From Teacher: Exploiting Trilateral Geometry For Knowledge Distillation
by: Hu, Chengming, et al.
Published: (2023)

A Teacher-Free Graph Knowledge Distillation Framework with Dual Self-Distillation
by: Wu, Lirong, et al.
Published: (2024)

Entropy Aware Reward Guidance for Diffusion Language Model Alignment
by: Tejaswi, Atula, et al.
Published: (2026)

Efficient Distillation of Classifier-Free Guidance using Adapters
by: Jensen, Cristian Perez, et al.
Published: (2025)

A Note on Knowledge Distillation Loss Function for Object Classification
by: Chen, Defang
Published: (2021)