Image de couverture de livre

On Catastrophic Forgetting in Low-Rank Decomposition-Based Parameter-Efficient Fine-Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Ahmad, Muhammad, Zheng, Jingjing, Cao, Yankai
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Adaptive Principal Components Allocation with the $\ell_{2,g}$-regularized Gaussian Graphical Model for Efficient Fine-Tuning Large Models
par: Zheng, Jingjing, et autres
Publié: (2024)

Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting
par: Chen, Haolin, et autres
Publié: (2024)

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
par: Ren, Weijieying, et autres
Publié: (2024)

CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
par: Fawi, Muhammad
Publié: (2024)

Low-Rank Adaptation Reduces Catastrophic Forgetting in Sequential Transformer Encoder Fine-Tuning: Controlled Empirical Evidence and Frozen-Backbone Representation Probes
par: Pandey, Ashish
Publié: (2026)

Overcoming Catastrophic Forgetting in Visual Continual Learning with Reinforcement Fine-Tuning
par: Lou, Meng, et autres
Publié: (2026)

Subspace Geometry Governs Catastrophic Forgetting in Low-Rank Adaptation
par: Steele, Brady
Publié: (2026)

CORE: Mitigating Catastrophic Forgetting in Continual Learning through Cognitive Replay
par: Zhang, Jianshu, et autres
Publié: (2024)

FuRA: Full-Rank Parameter-Efficient Fine-Tuning with Spectral Preconditioning
par: Zhao, Yequan, et autres
Publié: (2026)

Mitigating Catastrophic Forgetting with Adaptive Transformer Block Expansion in Federated Fine-Tuning
par: Huo, Yujia, et autres
Publié: (2025)

Attractor Patch Networks: Reducing Catastrophic Forgetting with Routed Low-Rank Patch Experts
par: Shashank
Publié: (2026)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
par: Zhang, Haojie
Publié: (2025)

GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
par: Jung, Yeonjoon, et autres
Publié: (2025)

An Efficient Rehearsal Scheme for Catastrophic Forgetting Mitigation during Multi-stage Fine-tuning
par: Bai, Andrew, et autres
Publié: (2024)

Avoid Catastrophic Forgetting with Rank-1 Fisher from Diffusion Models
par: Wang, Zekun, et autres
Publié: (2025)

LoRAPrune: Structured Pruning Meets Low-Rank Parameter-Efficient Fine-Tuning
par: Zhang, Mingyang, et autres
Publié: (2023)

Eidetic Learning: an Efficient and Provable Solution to Catastrophic Forgetting
par: Dronen, Nicholas, et autres
Publié: (2025)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
par: Jiang, Ting, et autres
Publié: (2024)

Fine-Grained Gradient Restriction: A Simple Approach for Mitigating Catastrophic Forgetting
par: Liu, Bo, et autres
Publié: (2024)

ARD-LoRA: Dynamic Rank Allocation for Parameter-Efficient Fine-Tuning of Foundation Models with Heterogeneous Adaptation Needs
par: Shinwari, Haseeb Ullah Khan, et autres
Publié: (2025)

Predicting the Susceptibility of Examples to Catastrophic Forgetting
par: Hacohen, Guy, et autres
Publié: (2024)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
par: Liu, Zeyu, et autres
Publié: (2024)

Don't Forget the Nonlinearity: Unlocking Activation Functions in Efficient Fine-Tuning
par: Yin, Bo, et autres
Publié: (2025)

ScaLoRA: Optimally Scaled Low-Rank Adaptation for Efficient High-Rank Fine-Tuning
par: Zhang, Yilang, et autres
Publié: (2025)

Mitigating Forgetting in Low Rank Adaptation
par: Sliwa, Joanna, et autres
Publié: (2025)

Memory-Efficient Fine-Tuning via Low-Rank Activation Compression
par: Shi, Jiang-Xin, et autres
Publié: (2025)

Sparsity-Aware Low-Rank Representation for Efficient Fine-Tuning of Large Language Models
par: Zhang, Longteng, et autres
Publié: (2026)

Catastrophic Forgetting Resilient One-Shot Incremental Federated Learning
par: Zaland, Obaidullah, et autres
Publié: (2026)

Task-Adaptive Parameter-Efficient Fine-Tuning for Weather Foundation Models
par: Cao, Shilei, et autres
Publié: (2025)

Graph-Based Spectral Decomposition for Parameter Coordination in Language Model Fine-Tuning
par: Zhang, Hanlu, et autres
Publié: (2025)

Measuring Catastrophic Forgetting in Cross-Lingual Transfer Paradigms: Exploring Tuning Strategies
par: Koloski, Boshko, et autres
Publié: (2023)

Mitigating Catastrophic Forgetting in Large Language Models with Forgetting-aware Pruning
par: Huang, Wei, et autres
Publié: (2025)

NoRA: Nested Low-Rank Adaptation for Efficient Fine-Tuning Large Models
par: Lin, Cheng, et autres
Publié: (2024)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
par: Yang, Yifan, et autres
Publié: (2024)

QR-LoRA: QR-Based Low-Rank Adaptation for Efficient Fine-Tuning of Large Language Models
par: Liang, Jessica, et autres
Publié: (2025)

Robust Policy Optimization to Prevent Catastrophic Forgetting
par: Sabbaghi, Mahdi, et autres
Publié: (2026)

Catastrophic Forgetting in Kolmogorov-Arnold Networks
par: Rahman, Mohammad Marufur, et autres
Publié: (2025)

Unlocking the Power of Function Vectors for Characterizing and Mitigating Catastrophic Forgetting in Continual Instruction Tuning
par: Jiang, Gangwei, et autres
Publié: (2025)

LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning
par: Du, Zhekai, et autres
Publié: (2025)

Decentralized Low-Rank Fine-Tuning of Large Language Models
par: Ghiasvand, Sajjad, et autres
Publié: (2025)