Imagen de Portada

OPLoRA: Orthogonal Projection LoRA Prevents Catastrophic Forgetting during Parameter-Efficient Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Xiong, Yifeng, Xie, Xiaohui
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
por: Tian, Chunlin, et al.
Publicado: (2024)

VB-LoRA: Extreme Parameter Efficient Fine-Tuning with Vector Banks
por: Li, Yang, et al.
Publicado: (2024)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
por: Azimi, Rambod, et al.
Publicado: (2024)

DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
por: Deng, Guanzhi, et al.
Publicado: (2026)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
por: Zhou, Hongyun, et al.
Publicado: (2024)

LoRA-PAR: A Flexible Dual-System LoRA Partitioning Approach to Efficient LLM Fine-Tuning
por: Huang, Yining, et al.
Publicado: (2025)

L1RA: Dynamic Rank Assignment in LoRA Fine-Tuning
por: Singh, Raul, et al.
Publicado: (2025)

LoRA-Drop: Temporal LoRA Decoding for Efficient LLM Inference
por: Rajabzadeh, Hossein, et al.
Publicado: (2026)

LoRA-Squeeze: Simple and Effective Post-Tuning and In-Tuning Compression of LoRA Modules
por: Vulić, Ivan, et al.
Publicado: (2026)

LoRA Learns Less and Forgets Less
por: Biderman, Dan, et al.
Publicado: (2024)

LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits
por: Zhou, Zikai, et al.
Publicado: (2025)

Dual LoRA: Enhancing LoRA with Magnitude and Direction Updates
por: Xu, Yixing, et al.
Publicado: (2025)

Faster Than SVD, Smarter Than SGD: The OPLoRA Alternating Update
por: Almansoori, Abdulla Jasem, et al.
Publicado: (2025)

CURLoRA: Stable LLM Continual Fine-Tuning and Catastrophic Forgetting Mitigation
por: Fawi, Muhammad
Publicado: (2024)

NAS-LoRA: Empowering Parameter-Efficient Fine-Tuning for Visual Foundation Models with Searchable Adaptation
por: Chen, Renqi, et al.
Publicado: (2025)

HypeLoRA: Hyper-Network-Generated LoRA Adapters for Calibrated Language Model Fine-Tuning
por: Trojan, Bartosz, et al.
Publicado: (2026)

MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
por: Li, Dengchun, et al.
Publicado: (2024)

LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR
por: Song, Zheshu, et al.
Publicado: (2024)

LoRA-SP: Streamlined Partial Parameter Adaptation for Resource-Efficient Fine-Tuning of Large Language Models
por: Wu, Yichao, et al.
Publicado: (2024)

Recover-to-Forget: Gradient Reconstruction from LoRA for Efficient LLM Unlearning
por: Liu, Yezi, et al.
Publicado: (2025)

LUNE: Efficient LLM Unlearning via LoRA Fine-Tuning with Negative Examples
por: Liu, Yezi, et al.
Publicado: (2025)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
por: Li, Jiacheng, et al.
Publicado: (2025)

LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models
por: Ran, Delong, et al.
Publicado: (2025)

Vision as LoRA
por: Wang, Han, et al.
Publicado: (2025)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
por: Barazandeh, Babak, et al.
Publicado: (2025)

LoRA$^2$ : Multi-Scale Low-Rank Approximations for Fine-Tuning Large Language Models
por: Zhang, Jia-Chen, et al.
Publicado: (2024)

Aletheia: Gradient-Guided Layer Selection for Efficient LoRA Fine-Tuning Across Architectures
por: Saket, Abdulmalek
Publicado: (2026)

MoE-Sieve: Routing-Guided LoRA for Efficient MoE Fine-Tuning
por: Manzoni, Andrea
Publicado: (2026)

MeTA-LoRA: Data-Efficient Multi-Task Fine-Tuning for Large Language Models
por: Cheng, Bo, et al.
Publicado: (2025)

CA-LoRA: Adapting Existing LoRA for Compressed LLMs to Enable Efficient Multi-Tasking on Personal Devices
por: Zhao, Weilin, et al.
Publicado: (2023)

$D^2LoRA$: Data-Driven LoRA Initialization for Low Resource Tasks
por: SeraJ, Javad, et al.
Publicado: (2025)

LoRA-Flow: Dynamic LoRA Fusion for Large Language Models in Generative Tasks
por: Wang, Hanqing, et al.
Publicado: (2024)

Disentangling Task Conflicts in Multi-Task LoRA via Orthogonal Gradient Projection
por: Yang, Ziyu, et al.
Publicado: (2026)

LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuning
por: Zhang, Longteng, et al.
Publicado: (2023)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
por: Lee, Seungeon, et al.
Publicado: (2025)

Not All LoRA Parameters Are Essential: Insights on Inference Necessity
por: Chen, Guanhua, et al.
Publicado: (2025)

FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation Models
por: Singhal, Raghav, et al.
Publicado: (2024)

On the Role of Encoder Depth: Pruning Whisper and LoRA Fine-Tuning in SLAM-ASR
por: Kolluri, Ganesh Pavan Kartikeya Bharadwaj, et al.
Publicado: (2026)

PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization
por: Meng, Xiangdi, et al.
Publicado: (2024)

Dynamic Adaptation of LoRA Fine-Tuning for Efficient and Task-Specific Optimization of Large Language Models
por: Liao, Xiaoxuan, et al.
Publicado: (2025)