Cover Image

Continual Distillation Learning: Knowledge Distillation in Prompt-based Continual Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Qifan, Guo, Yunhui, Xiang, Yu
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Densely Distilling Cumulative Knowledge for Continual Learning
by: Shi, Zenglin, et al.
Published: (2024)

Forward-Backward Knowledge Distillation for Continual Clustering
by: Sadeghi, Mohammadreza, et al.
Published: (2024)

An Attention-based Representation Distillation Baseline for Multi-Label Continual Learning
by: Menabue, Martin, et al.
Published: (2024)

Online Distillation with Continual Learning for Cyclic Domain Shifts
by: Houyon, Joachim, et al.
Published: (2023)

Dynamic Sub-graph Distillation for Robust Semi-supervised Continual Learning
by: Fan, Yan, et al.
Published: (2023)

PALM: Pushing Adaptive Learning Rate Mechanisms for Continual Test-Time Adaptation
by: Maharana, Sarthak Kumar, et al.
Published: (2024)

Multi-Level Knowledge Distillation and Dynamic Self-Supervised Learning for Continual Learning
by: Kim, Taeheon, et al.
Published: (2025)

Preview-based Category Contrastive Learning for Knowledge Distillation
by: Ding, Muhe, et al.
Published: (2024)

Continual Learning of Diffusion Models with Generative Distillation
by: Masip, Sergi, et al.
Published: (2023)

Brain-Inspired Continual Learning-Robust Feature Distillation and Re-Consolidation for Class Incremental Learning
by: Khan, Hikmat, et al.
Published: (2024)

Vector Quantization Prompting for Continual Learning
by: Jiao, Li, et al.
Published: (2024)

Continual Distillation of Teachers from Different Domains
by: Michel, Nicolas, et al.
Published: (2026)

Prompt Customization for Continual Learning
by: Dai, Yong, et al.
Published: (2024)

Enriching Knowledge Distillation with Intra-Class Contrastive Learning
by: Yuan, Hua, et al.
Published: (2025)

Pixel Distillation: A New Knowledge Distillation Scheme for Low-Resolution Image Recognition
by: Guo, Guangyu, et al.
Published: (2021)

Improving Knowledge Distillation in Transfer Learning with Layer-wise Learning Rates
by: Kokane, Shirley, et al.
Published: (2024)

Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
by: Mistretta, Marco, et al.
Published: (2024)

Large Scale Diffusion Distillation via Score-Regularized Continuous-Time Consistency
by: Zheng, Kaiwen, et al.
Published: (2025)

One-shot Federated Learning via Synthetic Distiller-Distillate Communication
by: Zhang, Junyuan, et al.
Published: (2024)

LAKD-Activation Mapping Distillation Based on Local Learning
by: Zhang, Yaoze, et al.
Published: (2024)

On Distilling the Displacement Knowledge for Few-Shot Class-Incremental Learning
by: Fang, Pengfei, et al.
Published: (2024)

Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality
by: Wang, Hu, et al.
Published: (2023)

H2ST: Hierarchical Two-Sample Tests for Continual Out-of-Distribution Detection
by: Liu, Yuhang, et al.
Published: (2025)

C^2Prompt: Class-aware Client Knowledge Interaction for Federated Continual Learning
by: Xu, Kunlun, et al.
Published: (2025)

FedHPL: Efficient Heterogeneous Federated Learning with Prompt Tuning and Logit Distillation
by: Ma, Yuting, et al.
Published: (2024)

Adapter-Enhanced Semantic Prompting for Continual Learning
by: Yin, Baocai, et al.
Published: (2024)

Semantic Prompting with Image-Token for Continual Learning
by: Han, Jisu, et al.
Published: (2024)

Consistent Prompting for Rehearsal-Free Continual Learning
by: Gao, Zhanxin, et al.
Published: (2024)

Distilled Prompt Learning for Incomplete Multimodal Survival Prediction
by: Xu, Yingxue, et al.
Published: (2025)

Align Your Flow: Scaling Continuous-Time Flow Map Distillation
by: Sabour, Amirmojtaba, et al.
Published: (2025)

Category Adaptation Meets Projected Distillation in Generalized Continual Category Discovery
by: Rypeść, Grzegorz, et al.
Published: (2023)

Distilling the Knowledge in Data Pruning
by: Ben-Baruch, Emanuel, et al.
Published: (2024)

MoPD: Mixture-of-Prompts Distillation for Vision-Language Models
by: Chen, Yang, et al.
Published: (2024)

Quantum-Gated Task-interaction Knowledge Distillation for Pre-trained Model-based Class-Incremental Learning
by: Li, Linjie, et al.
Published: (2026)

Dynamic Temperature Knowledge Distillation
by: Wei, Yukang, et al.
Published: (2024)

ReffAKD: Resource-efficient Autoencoder-based Knowledge Distillation
by: Doshi, Divyang, et al.
Published: (2024)

Mutually Causal Semantic Distillation Network for Zero-Shot Learning
by: Chen, Shiming, et al.
Published: (2026)

Guiding Distribution Matching Distillation with Gradient-Based Reinforcement Learning
by: Dong, Linwei, et al.
Published: (2026)

Continuous Subspace Optimization for Continual Learning
by: Cheng, Quan, et al.
Published: (2025)

Distilling Knowledge from Heterogeneous Architectures for Semantic Segmentation
by: Huang, Yanglin, et al.
Published: (2025)