Imagen de Portada

Rank-Accuracy Trade-off for LoRA: A Gradient-Flow Analysis

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Rushka, Michael, Klabjan, Diego
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

On the Convergence Rate of LoRA Gradient Descent
por: Mu, Siqiao, et al.
Publicado: (2025)

LoRA-GA: Low-Rank Adaptation with Gradient Approximation
por: Wang, Shaowen, et al.
Publicado: (2024)

FIM-LoRA: Task-Informative Rank Allocation for LoRA via Calibration-Time Gradient-Variance Estimation
por: Sathyavageeswaran, Ramakrishnan
Publicado: (2026)

Understanding the Learning Dynamics of LoRA: A Gradient Flow Perspective on Low-Rank Adaptation in Matrix Factorization
por: Xu, Ziqing, et al.
Publicado: (2025)

How Much is Too Much? Exploring LoRA Rank Trade-offs for Retaining Knowledge and Domain Robustness
por: Rathore, Darshita, et al.
Publicado: (2025)

Run LoRA Run: Faster and Lighter LoRA Implementations
por: Cherniuk, Daria, et al.
Publicado: (2023)

AuroRA: Breaking Low-Rank Bottleneck of LoRA with Nonlinear Mapping
por: Dong, Haonan, et al.
Publicado: (2025)

GeLoRA: Geometric Adaptive Ranks For Efficient LoRA Fine-tuning
por: Ed-dib, Abdessalam, et al.
Publicado: (2024)

Rethinking the Rank Threshold for LoRA Fine-Tuning
por: Park, Juneyoung
Publicado: (2026)

HRP: High-Rank Preheating for Superior LoRA Initialization
por: Chen, Yuzhu, et al.
Publicado: (2025)

IGU-LoRA: Adaptive Rank Allocation via Integrated Gradients and Uncertainty-Aware Scoring
por: Cui, Xuan, et al.
Publicado: (2026)

CE-LoRA: Computation-Efficient LoRA Fine-Tuning for Language Models
por: Chen, Guanduo, et al.
Publicado: (2025)

LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
por: Smith, Ethan, et al.
Publicado: (2024)

Cross-LoRA: A Data-Free LoRA Transfer Framework across Heterogeneous LLMs
por: Xia, Feifan, et al.
Publicado: (2025)

Block-Diagonal LoRA for Eliminating Communication Overhead in Tensor Parallel LoRA Serving
por: Wang, Xinyu, et al.
Publicado: (2025)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
por: Sheng, Ying, et al.
Publicado: (2023)

Understanding LoRA as Knowledge Memory: An Empirical Analysis
por: Back, Seungju, et al.
Publicado: (2026)

LoRA-drop: Efficient LoRA Parameter Pruning based on Output Evaluation
por: Zhou, Hongyun, et al.
Publicado: (2024)

C-LoRA: Continual Low-Rank Adaptation for Pre-trained Models
por: Zhang, Xin, et al.
Publicado: (2025)

Minimal Ranks, Maximum Confidence: Parameter-efficient Uncertainty Quantification for LoRA
por: Marszałek, Patryk, et al.
Publicado: (2025)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
por: Wang, Zhengbo, et al.
Publicado: (2024)

LoRA+: Efficient Low Rank Adaptation of Large Models
por: Hayou, Soufiane, et al.
Publicado: (2024)

Stable-LoRA: Stabilizing Feature Learning of Low-Rank Adaptation
por: Wu, Yize, et al.
Publicado: (2026)

Descend or Rewind? Stochastic Gradient Descent Unlearning
por: Mu, Siqiao, et al.
Publicado: (2025)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
por: Lee, Seungeon, et al.
Publicado: (2025)

CopRA: A Progressive LoRA Training Strategy
por: Zhuang, Zhan, et al.
Publicado: (2024)

On the Second-Order Convergence of Biased Policy Gradient Algorithms
por: Mu, Siqiao, et al.
Publicado: (2023)

Recover-LoRA: Data-Free Accuracy Recovery of Degraded Language Models via Low-Rank Adaptation
por: Das, Devleena, et al.
Publicado: (2025)

Bernoulli-LoRA: A Theoretical Framework for Randomized Low-Rank Adaptation
por: Sokolov, Igor, et al.
Publicado: (2025)

A Note on LoRA
por: Fomenko, Vlad, et al.
Publicado: (2024)

Latent Space Factorization in LoRA
por: Kumar, Shashi, et al.
Publicado: (2025)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
por: Shen, Yixin
Publicado: (2025)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
por: Liu, Jinda, et al.
Publicado: (2025)

AFA-LoRA: Enabling Non-Linear Adaptations in LoRA with Activation Function Annealing
por: Li, Jiacheng, et al.
Publicado: (2025)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
por: Li, Wenbing, et al.
Publicado: (2025)

GEM-Style Constraints for PEFT with Dual Gradient Projection in LoRA
por: Tekmen, Brian, et al.
Publicado: (2026)

IW-GAE: Importance Weighted Group Accuracy Estimation for Improved Calibration and Model Selection in Unsupervised Domain Adaptation
por: Joo, Taejong, et al.
Publicado: (2023)

LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis
por: Zhang, Qingyue, et al.
Publicado: (2025)

G2LoRA: Gradient Orthogonal Low-Rank Adaptation Framework for Graph Continual Learning on Text-Attributed Graphs
por: Wang, Yuhan, et al.
Publicado: (2026)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
por: Bian, Jieming, et al.
Publicado: (2024)