Imagen de Portada

LoRA$^2$ : Multi-Scale Low-Rank Approximations for Fine-Tuning Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Jia-Chen, Xiong, Yu-Jie, Qiu, He-Xi, Zhu, Dong-Hai, Xia, Chun-Ming
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Parameter-Efficient Fine-Tuning of Large Language Models via Deconvolution in Subspace
por: Zhang, Jia-Chen, et al.
Publicado: (2025)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
por: Barazandeh, Babak, et al.
Publicado: (2025)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
por: Chen, Guanduo, et al.
Publicado: (2025)

DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
por: Deng, Guanzhi, et al.
Publicado: (2026)

Rethinking the Rank Threshold for LoRA Fine-Tuning
por: Park, Juneyoung
Publicado: (2026)

LoRA-GA: Low-Rank Adaptation with Gradient Approximation
por: Wang, Shaowen, et al.
Publicado: (2024)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
por: Bian, Jieming, et al.
Publicado: (2024)

Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
por: Zhang, Chengqian, et al.
Publicado: (2026)

Sensitivity-LoRA: Low-Load Sensitivity-Based Fine-Tuning for Large Language Models
por: Zhang, Hao, et al.
Publicado: (2025)

QR-LoRA: QR-Based Low-Rank Adaptation for Efficient Fine-Tuning of Large Language Models
por: Liang, Jessica, et al.
Publicado: (2025)

L1RA: Dynamic Rank Assignment in LoRA Fine-Tuning
por: Singh, Raul, et al.
Publicado: (2025)

Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
por: Hu, Jerry Yao-Chieh, et al.
Publicado: (2024)

ADF-LoRA: Alternating Low-Rank Aggregation for Decentralized Federated Fine-Tuning
por: Wang, Xiaoyu, et al.
Publicado: (2025)

AuroRA: Breaking Low-Rank Bottleneck of LoRA with Nonlinear Mapping
por: Dong, Haonan, et al.
Publicado: (2025)

LoRA+: Efficient Low Rank Adaptation of Large Models
por: Hayou, Soufiane, et al.
Publicado: (2024)

MixLoRA: Enhancing Large Language Models Fine-Tuning with LoRA-based Mixture of Experts
por: Li, Dengchun, et al.
Publicado: (2024)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
por: Zhu, Zhanda, et al.
Publicado: (2025)

PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization
por: Meng, Xiangdi, et al.
Publicado: (2024)

UIR-LoRA: Achieving Universal Image Restoration through Multiple Low-Rank Adaptation
por: Zhang, Cheng, et al.
Publicado: (2024)

Bayesian-LoRA: Probabilistic Low-Rank Adaptation of Large Language Models
por: Lin, Moule, et al.
Publicado: (2026)

FM-LoRA: Factorized Low-Rank Meta-Prompting for Continual Learning
por: Yu, Xiaobing, et al.
Publicado: (2025)

Learning in the Fisher Subspace: A Guided Initialization for LoRA Fine-Tuning
por: Feng, Zhi-Quan, et al.
Publicado: (2026)

FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
por: Bian, Jieming, et al.
Publicado: (2026)

PLoRA: Efficient LoRA Hyperparameter Tuning for Large Models
por: Yan, Minghao, et al.
Publicado: (2025)

HydraLoRA: An Asymmetric LoRA Architecture for Efficient Fine-Tuning
por: Tian, Chunlin, et al.
Publicado: (2024)

LoRA-Leak: Membership Inference Attacks Against LoRA Fine-tuned Language Models
por: Ran, Delong, et al.
Publicado: (2025)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
por: Azimi, Rambod, et al.
Publicado: (2024)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
por: Wang, Zhengbo, et al.
Publicado: (2024)

Adaptive LoRA Experts Allocation and Selection for Federated Fine-Tuning
por: Wang, Lei, et al.
Publicado: (2025)

LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuning
por: Zhang, Longteng, et al.
Publicado: (2023)

Dynamic Adaptation of LoRA Fine-Tuning for Efficient and Task-Specific Optimization of Large Language Models
por: Liao, Xiaoxuan, et al.
Publicado: (2025)

Stabilized Fine-Tuning with LoRA in Federated Learning: Mitigating the Side Effect of Client Size and Rank via the Scaling Factor
por: Huang, Jiayu, et al.
Publicado: (2026)

GeLoRA: Geometric Adaptive Ranks For Efficient LoRA Fine-tuning
por: Ed-dib, Abdessalam, et al.
Publicado: (2024)

MeTA-LoRA: Data-Efficient Multi-Task Fine-Tuning for Large Language Models
por: Cheng, Bo, et al.
Publicado: (2025)

LowRA: Accurate and Efficient LoRA Fine-Tuning of LLMs under 2 Bits
por: Zhou, Zikai, et al.
Publicado: (2025)

Bi-LoRA: Efficient Sharpness-Aware Minimization for Fine-Tuning Large-Scale Models
por: Liu, Yuhang, et al.
Publicado: (2025)

InfiniLoRA: Disaggregated Multi-LoRA Serving for Large Language Models
por: Chen, Hongyu, et al.
Publicado: (2026)

OPLoRA: Orthogonal Projection LoRA Prevents Catastrophic Forgetting during Parameter-Efficient Fine-Tuning
por: Xiong, Yifeng, et al.
Publicado: (2025)

FedLoRA-Optimizer: Federated LoRA Fine-Tuning with Global and Local Optimization in Heterogeneous Data Scenarios
por: Zhao, Jianzhe, et al.
Publicado: (2025)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
por: Yang, Yaming, et al.
Publicado: (2024)