Image de couverture de livre

Mitigating Forgetting in Low Rank Adaptation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Sliwa, Joanna, Schneider, Frank, Hennig, Philipp, Hernandez-Lobato, Jose Miguel
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Low-Rank Filtering and Smoothing for Sequential Deep Learning
par: Sliwa, Joanna, et autres
Publié: (2024)

Sketching Low-Rank Plus Diagonal Matrices
par: Fernandez, Andres, et autres
Publié: (2025)

Spectral Imbalance Causes Forgetting in Low-Rank Continual Adaptation
par: Gu, Hao, et autres
Publié: (2026)

The Rank-Reduced Kalman Filter: Approximate Dynamical-Low-Rank Filtering In High Dimensions
par: Schmidt, Jonathan, et autres
Publié: (2023)

Subspace Geometry Governs Catastrophic Forgetting in Low-Rank Adaptation
par: Steele, Brady
Publié: (2026)

Connecting Parameter Magnitudes and Hessian Eigenspaces at Scale using Sketched Methods
par: Fernandez, Andres, et autres
Publié: (2025)

Accelerating Non-Conjugate Gaussian Processes By Trading Off Computation For Uncertainty
par: Tatzel, Lukas, et autres
Publié: (2023)

Kronecker-Factored Approximate Curvature for Modern Neural Network Architectures
par: Eschenhagen, Runa, et autres
Publié: (2023)

Norm-Bounded Low-Rank Adaptation
par: Wang, Ruigang, et autres
Publié: (2025)

An Empirical Analysis of Forgetting in Pre-trained Models with Incremental Low-Rank Updates
par: Soutif--Cormerais, Albin, et autres
Publié: (2024)

On Catastrophic Forgetting in Low-Rank Decomposition-Based Parameter-Efficient Fine-Tuning
par: Ahmad, Muhammad, et autres
Publié: (2026)

Low-Rank Adaptation Reduces Catastrophic Forgetting in Sequential Transformer Encoder Fine-Tuning: Controlled Empirical Evidence and Frozen-Backbone Representation Probes
par: Pandey, Ashish
Publié: (2026)

Low-Rank Adaptation of Neural Fields
par: Truong, Anh, et autres
Publié: (2025)

Mitigating Catastrophic Forgetting in Large Language Models with Forgetting-aware Pruning
par: Huang, Wei, et autres
Publié: (2025)

Provable Meta-Learning with Low-Rank Adaptations
par: Block, Jacob L., et autres
Publié: (2024)

The Primacy of Magnitude in Low-Rank Adaptation
par: Zhang, Zicheng, et autres
Publié: (2025)

Mixture-of-Subspaces in Low-Rank Adaptation
par: Wu, Taiqiang, et autres
Publié: (2024)

Low Rank Adaptation for Adversarial Perturbation
par: Liu, Han, et autres
Publié: (2026)

Studying K-FAC Heuristics by Viewing Adam through a Second-Order Lens
par: Clarke, Ross M., et autres
Publié: (2023)

AdaRank: Disagreement Based Module Rank Prediction for Low-rank Adaptation
par: Dong, Yihe
Publié: (2024)

Scalable Multi-Task Low-Rank Model Adaptation
par: Tian, Zichen, et autres
Publié: (2026)

Selective Aggregation for Low-Rank Adaptation in Federated Learning
par: Guo, Pengxin, et autres
Publié: (2024)

Diagnosing and fixing common problems in Bayesian optimization for molecule design
par: Tripp, Austin, et autres
Publié: (2024)

Context-Free Synthetic Data Mitigates Forgetting
par: Bansal, Parikshit, et autres
Publié: (2025)

Attractor Patch Networks: Reducing Catastrophic Forgetting with Routed Low-Rank Patch Experts
par: Shashank
Publié: (2026)

BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models
par: Chang, Yupeng, et autres
Publié: (2024)

Low-Rank Adaptation Redux for Large Models
par: Li, Bingcong, et autres
Publié: (2026)

Scalable Bayesian Inference for Nonlinear Conservation Laws
par: Weiland, Tim, et autres
Publié: (2026)

There Was Never a Bottleneck in Concept Bottleneck Models
par: Almudévar, Antonio, et autres
Publié: (2025)

Dynamic Low-Rank Sparse Adaptation for Large Language Models
par: Huang, Weizhong, et autres
Publié: (2025)

Hypernetwork-Driven Low-Rank Adaptation Across Attention Heads
par: Diep, Nghiem T., et autres
Publié: (2025)

Federated Low-Rank Adaptation for Foundation Models: A Survey
par: Yang, Yiyuan, et autres
Publié: (2025)

Decoupled PFNs: Identifiable Epistemic-Aleatoric Decomposition via Structured Synthetic Priors
par: Bergna, Richard, et autres
Publié: (2026)

Channel-Aware Low-Rank Adaptation in Time Series Forecasting
par: Nie, Tong, et autres
Publié: (2024)

The Expressive Power of Low-Rank Adaptation
par: Zeng, Yuchen, et autres
Publié: (2023)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
par: Tang, Chuanyu, et autres
Publié: (2024)

Forget to Generalize: Iterative Adaptation for Generalization in Federated Learning
par: Alotaibi, Abdulrahman, et autres
Publié: (2026)

Few-Shot Concept Unlearning with Low Rank Adaptation
par: Shreyas, Udaya, et autres
Publié: (2025)

Low Tensor-Rank Adaptation of Kolmogorov--Arnold Networks
par: Gao, Yihang, et autres
Publié: (2025)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
par: Si, Chongjie, et autres
Publié: (2025)