Imagen de Portada

Spectral Imbalance Causes Forgetting in Low-Rank Continual Adaptation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Gu, Hao, Luo, Mao-Lin, Zhou, Zi-Hao, Zhang, Han-Chen, Zhang, Min-Ling, Wei, Tong
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

KeepLoRA: Continual Learning with Residual Gradient Adaptation
por: Luo, Mao-Lin, et al.
Publicado: (2026)

LADA: Scalable Label-Specific CLIP Adapter for Continual Learning
por: Luo, Mao-Lin, et al.
Publicado: (2025)

DC-Merge: Improving Model Merging with Directional Consistency
por: Zhang, Han-Chen, et al.
Publicado: (2026)

Mitigating Forgetting in Low Rank Adaptation
por: Sliwa, Joanna, et al.
Publicado: (2025)

Continuous Contrastive Learning for Long-Tailed Semi-Supervised Recognition
por: Zhou, Zi-Hao, et al.
Publicado: (2024)

Weakly-Supervised Contrastive Learning for Imprecise Class Labels
por: Zhou, Zi-Hao, et al.
Publicado: (2025)

Anti-Forgetting Adaptation for Unsupervised Person Re-identification
por: Chen, Hao, et al.
Publicado: (2024)

Low Rank Adaptation for Adversarial Perturbation
por: Liu, Han, et al.
Publicado: (2026)

Subspace Geometry Governs Catastrophic Forgetting in Low-Rank Adaptation
por: Steele, Brady
Publicado: (2026)

Channel-Aware Low-Rank Adaptation in Time Series Forecasting
por: Nie, Tong, et al.
Publicado: (2024)

C-LoRA: Continual Low-Rank Adaptation for Pre-trained Models
por: Zhang, Xin, et al.
Publicado: (2025)

Breaking the Blocks: Continuous Low-Rank Decomposed Scaling for Unified LLM Quantization and Adaptation
por: Tang, Pingzhi, et al.
Publicado: (2026)

GeoRA: Geometry-Aware Low-Rank Adaptation for RLVR
por: Zhang, Jiaying, et al.
Publicado: (2026)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
por: Yang, Yaming, et al.
Publicado: (2024)

Low-Rank Adaptation of Evolutionary Deep Neural Networks for Efficient Learning of Time-Dependent PDEs
por: Zhang, Jiahao, et al.
Publicado: (2025)

Low-Rank Adaptation for Foundation Models: A Comprehensive Review
por: Yang, Menglin, et al.
Publicado: (2024)

SALAAD: Sparse And Low-Rank Adaptation via ADMM for Large Language Model Inference
por: Ma, Hao, et al.
Publicado: (2026)

Replay-Free Continual Low-Rank Adaptation with Dynamic Memory
por: Chen, Huancheng, et al.
Publicado: (2024)

MEGA: Second-Order Gradient Alignment for Catastrophic Forgetting Mitigation in GFSCIL
por: Pang, Jinhui, et al.
Publicado: (2025)

Polynomial Expansion Rank Adaptation: Enhancing Low-Rank Fine-Tuning with High-Order Interactions
por: Zhang, Wenhao, et al.
Publicado: (2026)

Mixture of Low Rank Adaptation with Partial Parameter Sharing for Time Series Forecasting
por: Pan, Licheng, et al.
Publicado: (2025)

BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
por: Wang, Yibin, et al.
Publicado: (2024)

HiP-LoRA: Budgeted Spectral Plasticity for Robust Low-Rank Adaptation
por: Chen, Lixian, et al.
Publicado: (2026)

Energy-Structured Low-Rank Adaptation for Continual Learning
por: Li, Longhua, et al.
Publicado: (2026)

Continual Generalized Category Discovery: Learning and Forgetting from a Bayesian Perspective
por: Dai, Hao, et al.
Publicado: (2025)

Dynamic Low-Rank Sparse Adaptation for Large Language Models
por: Huang, Weizhong, et al.
Publicado: (2025)

The Primacy of Magnitude in Low-Rank Adaptation
por: Zhang, Zicheng, et al.
Publicado: (2025)

Come Together, But Not Right Now: A Progressive Strategy to Boost Low-Rank Adaptation
por: Zhuang, Zhan, et al.
Publicado: (2025)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
por: Tang, Chuanyu, et al.
Publicado: (2024)

PVBF: A Framework for Mitigating Parameter Variation Imbalance in Online Continual Learning
por: Tao, Zelin, et al.
Publicado: (2025)

GraphLoRA: Structure-Aware Contrastive Low-Rank Adaptation for Cross-Graph Transfer Learning
por: Yang, Zhe-Rui, et al.
Publicado: (2024)

Joint Tensor-Train Parameterization for Efficient and Expressive Low-Rank Adaptation
por: Qi, Jun, et al.
Publicado: (2025)

Low-Rank Adaptation Redux for Large Models
por: Li, Bingcong, et al.
Publicado: (2026)

Uncertainty-Calibrated Test-Time Model Adaptation without Forgetting
por: Tan, Mingkui, et al.
Publicado: (2024)

Audio-Visual Continual Test-Time Adaptation without Forgetting
por: Maharana, Sarthak Kumar, et al.
Publicado: (2026)

iLoRA: Bayesian Low-Rank Adaptation with Latent Interaction Graphs for Microbiome Diagnosis
por: Song, Yang, et al.
Publicado: (2026)

Unbiased Gradient Low-Rank Projection
por: Pan, Rui, et al.
Publicado: (2025)

Stable-LoRA: Stabilizing Feature Learning of Low-Rank Adaptation
por: Wu, Yize, et al.
Publicado: (2026)

Balanced Data, Imbalanced Spectra: Unveiling Class Disparities with Spectral Imbalance
por: Kaushik, Chiraag, et al.
Publicado: (2024)

Norm-Bounded Low-Rank Adaptation
por: Wang, Ruigang, et al.
Publicado: (2025)