Low-Rank Adaptation Reduces Catastrophic Forgetting in Sequential Transformer Encoder Fine-Tuning: Controlled Empirical Evidence and Frozen-Backbone Representation Probes

Documenti analoghi

• On Catastrophic Forgetting in Low-Rank Decomposition-Based Parameter-Efficient Fine-Tuning
  di: Ahmad, Muhammad, et al.
  Pubblicazione: (2026)
• Subspace Geometry Governs Catastrophic Forgetting in Low-Rank Adaptation
  di: Steele, Brady
  Pubblicazione: (2026)
• Fine Tuning without Catastrophic Forgetting via Selective Low Rank Adaptation
  di: Bafghi, Reza Akbarian, et al.
  Pubblicazione: (2025)
• Attractor Patch Networks: Reducing Catastrophic Forgetting with Routed Low-Rank Patch Experts
  di: Shashank
  Pubblicazione: (2026)
• Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning
  di: Ren, Weijieying, et al.
  Pubblicazione: (2024)