Cover Image

Low-redundancy Distillation for Continual Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, RuiQi, Diao, Boyu, Huang, Libo, An, Zijia, Liu, Hangda, An, Zhulin, Xu, Yongjun
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Nonlinear Hash-based Optimization Method for SpMV on GPUs
by: Yan, Chen, et al.
Published: (2025)

Online Policy Distillation with Decision-Attention
by: Yu, Xinqiang, et al.
Published: (2024)

From Isolation to Integration: Building an Adaptive Expert Forest for Pre-Trained Model-based Class-Incremental Learning
by: Liu, Ruiqi, et al.
Published: (2026)

Continual Learning in the Frequency Domain
by: Liu, Ruiqi, et al.
Published: (2024)

Efficient Continual Learning through Frequency Decomposition and Integration
by: Liu, Ruiqi, et al.
Published: (2025)

CBPNet: A Continual Backpropagation Prompt Network for Alleviating Plasticity Loss on Edge Devices
by: Shao, Runjie, et al.
Published: (2025)

A Sensitivity-Driven Expert Allocation Method in LoRA-MoE for Efficient Fine-Tuning
by: Xu, Junzhou, et al.
Published: (2025)

On the Integration of Spatial-Temporal Knowledge: A Lightweight Approach to Atmospheric Time Series Forecasting
by: Fu, Yisong, et al.
Published: (2024)

IOR: Inversed Objects Replay for Incremental Object Detection
by: An, Zijia, et al.
Published: (2024)

Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecasting
by: Li, Yuqi, et al.
Published: (2025)

Hessian Aware Low-Rank Perturbation for Order-Robust Continual Learning
by: Li, Jiaqi, et al.
Published: (2023)

Merlin: Multi-View Representation Learning for Robust Multivariate Time Series Forecasting with Unfixed Missing Rates
by: Yu, Chengqing, et al.
Published: (2025)

Maintaining Adversarial Robustness in Continuous Learning
by: Ru, Xiaolei, et al.
Published: (2024)

ARIES: Relation Assessment and Model Recommendation for Deep Time Series Forecasting
by: Wang, Fei, et al.
Published: (2025)

Potential Energy based Mixture Model for Noisy Label Learning
by: Wang, Zijia, et al.
Published: (2024)

Energy-Structured Low-Rank Adaptation for Continual Learning
by: Li, Longhua, et al.
Published: (2026)

Training with Confidence: Catching Silent Errors in Deep Learning Training with Automated Proactive Checks
by: Jiang, Yuxuan, et al.
Published: (2025)

Dynamical Adapter Fusion: Constructing A Global Adapter for Pre-Trained Model-based Class-Incremental Learning
by: Liu, Ruiqi, et al.
Published: (2026)

Prompt-Driven Continual Graph Learning
by: Wang, Qi, et al.
Published: (2025)

Teach Harder, Learn Poorer: Rethinking Hard Sample Distillation for GNN-to-MLP Knowledge Distillation
by: Wu, Lirong, et al.
Published: (2024)

Low-Complexity Inference in Continual Learning via Compressed Knowledge Transfer
by: Liu, Zhenrong, et al.
Published: (2025)

Rethinking Momentum Knowledge Distillation in Online Continual Learning
by: Michel, Nicolas, et al.
Published: (2023)

Seeking the Sufficiency and Necessity Causal Features in Multimodal Representation Learning
by: Chen, Boyu, et al.
Published: (2024)

Parameterized Prompt for Incremental Object Detection
by: An, Zijia, et al.
Published: (2025)

Dataset Distillation for Offline Reinforcement Learning
by: Light, Jonathan, et al.
Published: (2024)

Fair Dataset Distillation via Cross-Group Barycenter Alignment
by: Moslemi, Mohammad Hossein, et al.
Published: (2026)

Scale redundancy and soft gauge fixing in positively homogeneous neural networks
by: Terin, Rodrigo Carmo
Published: (2026)

Dynamic Chain-of-Thought: Towards Adaptive Deep Reasoning
by: Wang, Libo
Published: (2025)

Feature Distillation is the Better Choice for Model-Heterogeneous Federated Learning
by: Li, Yichen, et al.
Published: (2025)

GAR: Generative Adversarial Reinforcement Learning for Formal Theorem Proving
by: Wang, Ruida, et al.
Published: (2025)

DeLo: Dual Decomposed Low-Rank Experts Collaboration for Continual Missing Modality Learning
by: Liu, Xiwei, et al.
Published: (2026)

ElastiFormer: Learned Redundancy Reduction in Transformer via Self-Distillation
by: Liu, Junzhang, et al.
Published: (2024)

Cross-domain Random Pre-training with Prototypes for Reinforcement Learning
by: Liu, Xin, et al.
Published: (2023)

Federated Learning on Virtual Heterogeneous Data with Local-global Distillation
by: Huang, Chun-Yin, et al.
Published: (2023)

Information-Theoretic Dual Memory System for Continual Learning
by: Wu, RunQing, et al.
Published: (2025)

HEAL: Hindsight Entropy-Assisted Learning for Reasoning Distillation
by: Zhang, Wenjing, et al.
Published: (2026)

Representation Finetuning for Continual Learning
by: Luo, Haihua, et al.
Published: (2026)

Unimodal-driven Distillation in Multimodal Emotion Recognition with Dynamic Fusion
by: Li, Jiagen, et al.
Published: (2025)

Reset & Distill: A Recipe for Overcoming Negative Transfer in Continual Reinforcement Learning
by: Ahn, Hongjoon, et al.
Published: (2024)

Learning Interpretable Low-dimensional Representation via Physical Symmetry
by: Liu, Xuanjie, et al.
Published: (2023)