On Catastrophic Forgetting in Low-Rank Decomposition-Based Parameter-Efficient Fine-Tuning

Ähnliche Einträge

• Adaptive Principal Components Allocation with the $\ell_{2,g}$-regularized Gaussian Graphical Model for Efficient Fine-Tuning Large Models
  von: Zheng, Jingjing, et al.
  Veröffentlicht: (2024)
• Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting
  von: Chen, Haolin, et al.
  Veröffentlicht: (2024)
• Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
  von: Ren, Weijieying, et al.
  Veröffentlicht: (2024)
• CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
  von: Fawi, Muhammad
  Veröffentlicht: (2024)
• Low-Rank Adaptation Reduces Catastrophic Forgetting in Sequential Transformer Encoder Fine-Tuning: Controlled Empirical Evidence and Frozen-Backbone Representation Probes
  von: Pandey, Ashish
  Veröffentlicht: (2026)