Imagen de Portada

Rethinking the Rank Threshold for LoRA Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Park, Juneyoung
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Riemannian Optimization for LoRA on the Stiefel Manifold
por: Park, Juneyoung, et al.
Publicado: (2025)

Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
por: Zhang, Chengqian, et al.
Publicado: (2026)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
por: Azimi, Rambod, et al.
Publicado: (2024)

Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
por: Hu, Jerry Yao-Chieh, et al.
Publicado: (2024)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
por: Barazandeh, Babak, et al.
Publicado: (2025)

FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
por: Bian, Jieming, et al.
Publicado: (2026)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
por: Shen, Yixin
Publicado: (2025)

AR1-ZO: Topology-Aware Rank-1 Zeroth-Order Queries for High-Rank LoRA Fine-Tuning
por: Chen, Ziye, et al.
Publicado: (2026)

Parameter-Efficient Fine-Tuning for HAR: Integrating LoRA and QLoRA into Transformer Models
por: Seregina, Irina, et al.
Publicado: (2025)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
por: Zhu, Zhanda, et al.
Publicado: (2025)

FedMomentum: Preserving LoRA Training Momentum in Federated Fine-Tuning
por: Yan, Peishen, et al.
Publicado: (2026)

Convergence Analysis of Aggregation-Broadcast in LoRA-enabled Distributed Fine-Tuning
por: Chen, Xin, et al.
Publicado: (2025)

$α$-LoRA: Effective Fine-Tuning via Base Model Rescaling
por: Firdoussi, Aymane El, et al.
Publicado: (2025)

mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs
por: Ye, Zhengmao, et al.
Publicado: (2023)

ARD-LoRA: Dynamic Rank Allocation for Parameter-Efficient Fine-Tuning of Foundation Models with Heterogeneous Adaptation Needs
por: Shinwari, Haseeb Ullah Khan, et al.
Publicado: (2025)

GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Jung, Yeonjoon, et al.
Publicado: (2025)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
por: Luo, Minrui, et al.
Publicado: (2025)

Origin Tracer: A Method for Detecting LoRA Fine-Tuning Origins in LLMs
por: Liang, Hongyu, et al.
Publicado: (2025)

Activated LoRA: Fine-tuned LLMs for Intrinsics
por: Greenewald, Kristjan, et al.
Publicado: (2025)

Wireless Federated Multi-Task LLM Fine-Tuning via Sparse-and-Orthogonal LoRA
por: Yang, Nuocheng, et al.
Publicado: (2026)

Echo-LoRA: Parameter-Efficient Fine-Tuning via Cross-Layer Representation Injection
por: Peng, Yihang, et al.
Publicado: (2026)

On-the-Fly Adaptation to Quantization: Configuration-Aware LoRA for Efficient Fine-Tuning of Quantized LLMs
por: Ye, Rongguang, et al.
Publicado: (2025)

Bi-LoRA: Efficient Sharpness-Aware Minimization for Fine-Tuning Large-Scale Models
por: Liu, Yuhang, et al.
Publicado: (2025)

CLoQ: Enhancing Fine-Tuning of Quantized LLMs via Calibrated LoRA Initialization
por: Deng, Yanxia, et al.
Publicado: (2025)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
por: Zuo, Jingwei, et al.
Publicado: (2026)

Rethinking Parameter Sharing for LLM Fine-Tuning with Multiple LoRAs
por: Ban, Hao, et al.
Publicado: (2025)

Rethinking LoRA for Privacy-Preserving Federated Learning in Large Models
por: Liu, Jin, et al.
Publicado: (2026)

Profiling LoRA/QLoRA Fine-Tuning Efficiency on Consumer GPUs: An RTX 4060 Case Study
por: Avinash, MSR
Publicado: (2025)

FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic
por: Choi, Kanghyun, et al.
Publicado: (2025)

Stable-LoRA: Stabilizing Feature Learning of Low-Rank Adaptation
por: Wu, Yize, et al.
Publicado: (2026)

A Sensitivity-Driven Expert Allocation Method in LoRA-MoE for Efficient Fine-Tuning
por: Xu, Junzhou, et al.
Publicado: (2025)

TT-LoRA MoE: Unifying Parameter-Efficient Fine-Tuning and Sparse Mixture-of-Experts
por: Kunwar, Pradip, et al.
Publicado: (2025)

MiCA Learns More Knowledge Than LoRA and Full Fine-Tuning
por: Rüdiger, Sten, et al.
Publicado: (2026)

R-LoRA: Randomized Multi-Head LoRA for Efficient Multi-Task Learning
por: Liu, Jinda, et al.
Publicado: (2025)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
por: Li, Wenbing, et al.
Publicado: (2025)

Rethinking LoRA for Data Heterogeneous Federated Learning: Subspace and State Alignment
por: Peng, Hongyi, et al.
Publicado: (2026)

Exploring Gradient Subspaces: Addressing and Overcoming LoRA's Limitations in Federated Fine-Tuning of Large Language Models
por: Mahla, Navyansh, et al.
Publicado: (2024)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
por: Wang, Zhengbo, et al.
Publicado: (2024)

LoRA+: Efficient Low Rank Adaptation of Large Models
por: Hayou, Soufiane, et al.
Publicado: (2024)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
por: Zhou, Shuaipeng, et al.
Publicado: (2026)