Cover Image

Generative Diffusion Prior Distillation for Long-Context Knowledge Transfer

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Udayangani, Nilushika, Nandakishor, Kishor, Palaniswami, Marimuthu
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning to Reason: Temporal Saliency Distillation for Interpretable Knowledge Transfer
by: Dehigahawattage, Nilushika Udayangani Hewa, et al.
Published: (2026)

MemKD: Memory-Discrepancy Knowledge Distillation for Efficient Time Series Classification
by: Udayangani, Nilushika, et al.
Published: (2026)

SalesRLAgent: A Reinforcement Learning Approach for Real-Time Sales Conversion Prediction and Optimization
by: M, Nandakishor
Published: (2025)

Multi-Teacher Knowledge Distillation via Teacher-Informed Mixture Priors
by: Fang, Luyang, et al.
Published: (2026)

Training Plug-n-Play Knowledge Modules with Deep Context Distillation
by: Caccia, Lucas, et al.
Published: (2025)

Teach Me to Trick: Exploring Adversarial Transferability via Knowledge Distillation
by: Pradhan, Siddhartha, et al.
Published: (2025)

Model Mimic Attack: Knowledge Distillation for Provably Transferable Adversarial Examples
by: Lukyanov, Kirill, et al.
Published: (2024)

Latent Context Compilation: Distilling Long Context into Compact Portable Memory
by: Li, Zeju, et al.
Published: (2026)

Distilling Symbolic Priors for Concept Learning into Neural Networks
by: Marinescu, Ioana, et al.
Published: (2024)

Delta Sampling: Data-Free Knowledge Transfer Across Diffusion Models
by: Gao, Zhidong, et al.
Published: (2025)

In-Context Reinforcement Learning through Bayesian Fusion of Context and Value Prior
by: Berkes, Anaïs, et al.
Published: (2026)

On Explaining Knowledge Distillation: Measuring and Visualising the Knowledge Transfer Process
by: Adhane, Gereziher, et al.
Published: (2024)

Generalizing Teacher Networks for Effective Knowledge Distillation Across Student Architectures
by: Binici, Kuluhan, et al.
Published: (2024)

Context Distillation as Latent Memory Management
by: Zheng, Ziyang, et al.
Published: (2026)

Short-Term-to-Long-Term Memory Transfer for Knowledge Graphs under Partial Observability
by: Kim, Taewoon, et al.
Published: (2026)

Robust and Resource-Efficient Data-Free Knowledge Distillation by Generative Pseudo Replay
by: Binici, Kuluhan, et al.
Published: (2022)

Learning from Risk: LLM-Guided Generation of Safety-Critical Scenarios with Prior Knowledge
by: Wang, Yuhang, et al.
Published: (2025)

TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models
by: Shing, Makoto, et al.
Published: (2025)

Graph Knowledge Distillation to Mixture of Experts
by: Rumiantsev, Pavel, et al.
Published: (2024)

Dynamic Temperature Scheduler for Knowledge Distillation
by: Islam, Sibgat Ul, et al.
Published: (2025)

Membership and Memorization in LLM Knowledge Distillation
by: Zhang, Ziqi, et al.
Published: (2025)

Jump Starting Bandits with LLM-Generated Prior Knowledge
by: Alamdari, Parand A., et al.
Published: (2024)

Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
by: Wu, Wenyuan, et al.
Published: (2025)

DRAG: Distilling RAG for SLMs from LLMs to Transfer Knowledge and Mitigate Hallucination via Evidence and Graph-based Distillation
by: Chen, Jennifer, et al.
Published: (2025)

TimeBridge: Better Diffusion Prior Design with Bridge Models for Time Series Generation
by: Park, Jinseong, et al.
Published: (2024)

Learning Long-Context Diffusion Policies via Past-Token Prediction
by: Torne, Marcel, et al.
Published: (2025)

C2G-KD: PCA-Constrained Generator for Data-Free Knowledge Distillation
by: Bengtsson, Magnus, et al.
Published: (2025)

Low-Dimensional Federated Knowledge Graph Embedding via Knowledge Distillation
by: Zhang, Xiaoxiong, et al.
Published: (2024)

On the Memorization of Consistency Distillation for Diffusion Models
by: Jiang, Bingqing, et al.
Published: (2026)

Physics Informed Distillation for Diffusion Models
by: Tee, Joshua Tian Jin, et al.
Published: (2024)

Few-Shot Class-Incremental Learning with Prior Knowledge
by: Jiang, Wenhao, et al.
Published: (2024)

Knowledge Distillation Must Account for What It Loses
by: Wang, Wenshuo
Published: (2026)

Reinforcement-aware Knowledge Distillation for LLM Reasoning
by: Zhang, Zhaoyang, et al.
Published: (2026)

Collaborative Adaptive Curriculum for Progressive Knowledge Distillation
by: Liu, Jing, et al.
Published: (2026)

Long Context In-Context Compression by Getting to the Gist of Gisting
by: Petrov, Aleksandar, et al.
Published: (2025)

Right Time to Learn:Promoting Generalization via Bio-inspired Spacing Effect in Knowledge Distillation
by: Sun, Guanglong, et al.
Published: (2025)

Bridging Classical and Quantum Machine Learning: Knowledge Transfer From Classical to Quantum Neural Networks Using Knowledge Distillation
by: Hasan, Mohammad Junayed, et al.
Published: (2023)

Towards Context-Aware Domain Generalization: Understanding the Benefits and Limits of Marginal Transfer Learning
by: Müller, Jens, et al.
Published: (2023)

Forecasting Unseen Points of Interest Visits Using Context and Proximity Priors
by: Li, Ziyao, et al.
Published: (2024)

USP: A Unified Sequence Parallelism Approach for Long Context Generative AI
by: Fang, Jiarui, et al.
Published: (2024)