Image de couverture de livre

Gated Integration of Low-Rank Adaptation for Continual Learning of Large Language Models

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Liang, Yan-Shuo, Chen, Jia-Rui, Li, Wu-Jun
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

InfLoRA: Interference-Free Low-Rank Adaptation for Continual Learning
par: Liang, Yan-Shuo, et autres
Publié: (2024)

NLoRA: Nyström-Initiated Low-Rank Adaptation for Large Language Models
par: Guo, Chenlu, et autres
Publié: (2025)

Orthogonal Low-rank Adaptation in Lie Groups for Continual Learning of Large Language Models
par: Cao, Kefan, et autres
Publié: (2025)

DenseLoRA: Dense Low-Rank Adaptation of Large Language Models
par: Mu, Lin, et autres
Publié: (2025)

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models
par: Lu, Yuheng, et autres
Publié: (2024)

Dual-Pipeline with Low-Rank Adaptation for New Language Integration in Multilingual ASR
par: Khassanov, Yerbolat, et autres
Publié: (2024)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
par: Lin, Weicheng, et autres
Publié: (2026)

RaSA: Rank-Sharing Low-Rank Adaptation
par: He, Zhiwei, et autres
Publié: (2025)

LoRS: Efficient Low-Rank Adaptation for Sparse Large Language Model
par: Hu, Yuxuan, et autres
Publié: (2025)

OLoRA: Orthonormal Low-Rank Adaptation of Large Language Models
par: Büyükakyüz, Kerim
Publié: (2024)

Derivative-Free Optimization for Low-Rank Adaptation in Large Language Models
par: Jin, Feihu, et autres
Publié: (2024)

LCQ: Low-Rank Codebook based Quantization for Large Language Models
par: Cai, Wen-Pu, et autres
Publié: (2024)

Flexora: Flexible Low Rank Adaptation for Large Language Models
par: Wei, Chenxing, et autres
Publié: (2024)

LoRTA: Low Rank Tensor Adaptation of Large Language Models
par: Hounie, Ignacio, et autres
Publié: (2024)

Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models
par: Onal, Emre, et autres
Publié: (2024)

ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models
par: Liu, Zequan, et autres
Publié: (2024)

Astra: Activation-Space Tail-Eigenvector Low-Rank Adaptation of Large Language Models
par: Liu, Kainan, et autres
Publié: (2026)

SkipCat: Rank-Maximized Low-Rank Compression of Large Language Models via Shared Projection and Block Skipping
par: Lu, Yu-Chen, et autres
Publié: (2025)

MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning
par: Zhang, Jingfan, et autres
Publié: (2024)

GLoRIA: Gated Low-Rank Interpretable Adaptation for Dialectal ASR
par: Mehralian, Pouya, et autres
Publié: (2026)

Refining Sentence Embedding Model through Ranking Sentences Generation with Large Language Models
par: He, Liyang, et autres
Publié: (2025)

BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models
par: Chang, Yupeng, et autres
Publié: (2024)

Boosting Large Language Models with Continual Learning for Aspect-based Sentiment Analysis
par: Ding, Xuanwen, et autres
Publié: (2024)

BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
par: Wang, Yibin, et autres
Publié: (2024)

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning
par: Rajabzadeh, Hossein, et autres
Publié: (2024)

AdaMoLE: Fine-Tuning Large Language Models with Adaptive Mixture of Low-Rank Adaptation Experts
par: Liu, Zefang, et autres
Publié: (2024)

CoLA: Collaborative Low-Rank Adaptation
par: Zhou, Yiyun, et autres
Publié: (2025)

Why LoRA Fails to Forget: Regularized Low-Rank Adaptation Against Backdoors in Language Models
par: Luong, Hoang-Chau, et autres
Publié: (2026)

MEMLA: Enhancing Multilingual Knowledge Editing with Neuron-Masked Low-Rank Adaptation
par: Xie, Jiakuan, et autres
Publié: (2024)

CoRA: Optimizing Low-Rank Adaptation with Common Subspace of Large Language Models
par: Xiao, Xiaojun, et autres
Publié: (2024)

Efficient Continual Learning in Neural Machine Translation: A Low-Rank Adaptation Approach
par: Carrión, Salvador, et autres
Publié: (2025)

LoRA$^2$ : Multi-Scale Low-Rank Approximations for Fine-Tuning Large Language Models
par: Zhang, Jia-Chen, et autres
Publié: (2024)

Low-Rank Adaptation with Task-Relevant Feature Enhancement for Fine-tuning Language Models
par: Li, Changqun, et autres
Publié: (2024)

LoRA+: Efficient Low Rank Adaptation of Large Models
par: Hayou, Soufiane, et autres
Publié: (2024)

Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection
par: Palaskar, Shruti, et autres
Publié: (2024)

SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
par: Zhou, Kaiye, et autres
Publié: (2024)

Enhancing Low-Rank Adaptation with Structured Nonlinear Transformations
par: Deng, Guanzhi, et autres
Publié: (2025)

Penrose Tiled Low-Rank Compression and Section-Wise Q&A Fine-Tuning: A General Framework for Domain-Specific Large Language Model Adaptation
par: Kuo, Chuan-Wei, et autres
Publié: (2025)

CASCADE: Case-Based Continual Adaptation for Large Language Models During Deployment
par: Guo, Siyuan, et autres
Publié: (2026)

KG-Rank: Enhancing Large Language Models for Medical QA with Knowledge Graphs and Ranking Techniques
par: Yang, Rui, et autres
Publié: (2024)