Cover Image

Revisiting Weight Regularization for Low-Rank Continual Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zheng, Yaoyue, Zhang, Yin, van de Weijer, Joost, van de Ven, Gido M, Du, Shaoyi, Zhang, Xuetao, Tian, Zhiqiang
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

On the Computation of the Fisher Information in Continual Learning
by: van de Ven, Gido M.
Published: (2025)

Improving Continual Learning Performance and Efficiency with Auxiliary Classifiers
by: Szatkowski, Filip, et al.
Published: (2024)

Energy-Based Models for Continual Learning
by: Li, Shuang, et al.
Published: (2020)

Continual Learning and Catastrophic Forgetting
by: van de Ven, Gido M., et al.
Published: (2024)

Putting a Face to Forgetting: Continual Learning meets Mechanistic Interpretability
by: Masip, Sergi, et al.
Published: (2026)

Two Complementary Perspectives to Continual Learning: Ask Not Only What to Optimize, But Also How
by: Hess, Timm, et al.
Published: (2023)

Knowledge Accumulation in Continually Learned Representations and the Issue of Feature Forgetting
by: Hess, Timm, et al.
Published: (2023)

Continual Learning of Diffusion Models with Generative Distillation
by: Masip, Sergi, et al.
Published: (2023)

An Empirical Analysis of Forgetting in Pre-trained Models with Incremental Low-Rank Updates
by: Soutif--Cormerais, Albin, et al.
Published: (2024)

Prediction Error-based Classification for Class-Incremental Learning
by: Zając, Michał, et al.
Published: (2023)

Query Drift Compensation: Enabling Compatibility in Continual Learning of Retrieval Embedding Models
by: Goswami, Dipam, et al.
Published: (2025)

FeCAM: Exploiting the Heterogeneity of Class Distributions in Exemplar-Free Continual Learning
by: Goswami, Dipam, et al.
Published: (2023)

Infinite dSprites for Disentangled Continual Learning: Separating Memory Edits from Generalization
by: Dziadzio, Sebastian, et al.
Published: (2023)

CLA: Latent Alignment for Online Continual Self-Supervised Learning
by: Cignoni, Giacomo, et al.
Published: (2025)

Replay-free Online Continual Learning with Self-Supervised MultiPatches
by: Cignoni, Giacomo, et al.
Published: (2025)

The Expanding Scope of the Stability Gap: Unveiling its Presence in Joint Incremental Learning of Homogeneous Tasks
by: Kamath, Sandesh, et al.
Published: (2024)

Continual Learning for VLMs: A Survey and Taxonomy Beyond Forgetting
by: Liu, Yuyang, et al.
Published: (2025)

Continual Learning: Applications and the Road Forward
by: Verwimp, Eli, et al.
Published: (2023)

Modular Memory is the Key to Continual Learning Agents
by: Dorovatas, Vaggelis, et al.
Published: (2026)

Lifelong Learning of Video Diffusion Models From a Single Video Stream
by: Yoo, Jason, et al.
Published: (2024)

On the importance of cross-task features for class-incremental learning
by: Soutif--Cormerais, Albin, et al.
Published: (2021)

Continual Learning in the Presence of Repetition
by: Hemati, Hamed, et al.
Published: (2024)

Low-Rank Tensor Learning by Generalized Nonconvex Regularization
by: Xia, Sijia, et al.
Published: (2024)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
by: Si, Chongjie, et al.
Published: (2025)

Elastic Feature Consolidation for Cold Start Exemplar-Free Incremental Learning
by: Magistri, Simone, et al.
Published: (2024)

From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories, and Applications
by: Jaiswal, Ajay, et al.
Published: (2024)

No Task Left Behind: Isotropic Model Merging with Common and Task-Specific Subspaces
by: Marczak, Daniel, et al.
Published: (2025)

MGDA: Model-based Goal Data Augmentation for Offline Goal-conditioned Weighted Supervised Learning
by: Lei, Xing, et al.
Published: (2024)

Efficient Alternating Minimization with Applications to Weighted Low Rank Approximation
by: Song, Zhao, et al.
Published: (2023)

Covariances for Free: Exploiting Mean Distributions for Training-free Federated Learning
by: Goswami, Dipam, et al.
Published: (2024)

Different Prompts, Different Ranks: Prompt-aware Dynamic Rank Selection for SVD-based LLM Compression
by: Zhu, Hengyi, et al.
Published: (2026)

Assessing Open-world Forgetting in Generative Image Model Customization
by: Laria, Héctor, et al.
Published: (2024)

Sharpness-Aware Minimization Revisited: Weighted Sharpness as a Regularization Term
by: Yue, Yun, et al.
Published: (2023)

Energy-Structured Low-Rank Adaptation for Continual Learning
by: Li, Longhua, et al.
Published: (2026)

Q-WSL: Optimizing Goal-Conditioned RL with Weighted Supervised Learning via Dynamic Programming
by: Lei, Xing, et al.
Published: (2024)

PLAN: Proactive Low-Rank Allocation for Continual Learning
by: Wang, Xiequn, et al.
Published: (2025)

Layer-wise Weight Selection for Power-Efficient Neural Network Acceleration
by: Fang, Jiaxun, et al.
Published: (2025)

Cross-Modal Prototype Alignment and Mixing for Training-Free Few-Shot Classification
by: Goswami, Dipam, et al.
Published: (2026)

IsoCLIP: Decomposing CLIP Projectors for Efficient Intra-modal Alignment
by: Magistri, Simone, et al.
Published: (2026)

Continual Learning Should Move Beyond Incremental Classification
by: Mitchell, Rupert, et al.
Published: (2025)