Imagen de Portada

Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Chengqian, Zhu, Wei, Lee, Kyumin
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
por: Hu, Jerry Yao-Chieh, et al.
Publicado: (2024)

Rethinking the Rank Threshold for LoRA Fine-Tuning
por: Park, Juneyoung
Publicado: (2026)

Stable-LoRA: Stabilizing Feature Learning of Low-Rank Adaptation
por: Wu, Yize, et al.
Publicado: (2026)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
por: Azimi, Rambod, et al.
Publicado: (2024)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
por: Barazandeh, Babak, et al.
Publicado: (2025)

LoRA+: Efficient Low Rank Adaptation of Large Models
por: Hayou, Soufiane, et al.
Publicado: (2024)

FedMomentum: Preserving LoRA Training Momentum in Federated Fine-Tuning
por: Yan, Peishen, et al.
Publicado: (2026)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
por: Shen, Yixin
Publicado: (2025)

GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Jung, Yeonjoon, et al.
Publicado: (2025)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
por: Yang, Yaming, et al.
Publicado: (2024)

ARD-LoRA: Dynamic Rank Allocation for Parameter-Efficient Fine-Tuning of Foundation Models with Heterogeneous Adaptation Needs
por: Shinwari, Haseeb Ullah Khan, et al.
Publicado: (2025)

LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis
por: Zhang, Qingyue, et al.
Publicado: (2025)

FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
por: Bian, Jieming, et al.
Publicado: (2026)

On-the-Fly Adaptation to Quantization: Configuration-Aware LoRA for Efficient Fine-Tuning of Quantized LLMs
por: Ye, Rongguang, et al.
Publicado: (2025)

LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
por: Bałazy, Klaudia, et al.
Publicado: (2024)

MiCA Learns More Knowledge Than LoRA and Full Fine-Tuning
por: Rüdiger, Sten, et al.
Publicado: (2026)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
por: Zhu, Zhanda, et al.
Publicado: (2025)

Laplacian-LoRA: Delaying Oversmoothing in Deep GCNs via Spectral Low-Rank Adaptation
por: Alisetti, Sai Vamsi
Publicado: (2026)

SCALE-LoRA: Auditing Post-Retrieval LoRA Composition with Residual Merging and View Reliability
por: Zhou, Shuaipeng, et al.
Publicado: (2026)

ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecasting
por: Ruan, Weilin, et al.
Publicado: (2024)

AR1-ZO: Topology-Aware Rank-1 Zeroth-Order Queries for High-Rank LoRA Fine-Tuning
por: Chen, Ziye, et al.
Publicado: (2026)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
por: Zuo, Jingwei, et al.
Publicado: (2026)

FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic
por: Choi, Kanghyun, et al.
Publicado: (2025)

CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Models
por: Wang, Zhuxuanzi, et al.
Publicado: (2025)

LoRA-One: One-Step Full Gradient Could Suffice for Fine-Tuning Large Language Models, Provably and Efficiently
por: Zhang, Yuanhe, et al.
Publicado: (2025)

mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs
por: Ye, Zhengmao, et al.
Publicado: (2023)

Parameter-Efficient Fine-Tuning for HAR: Integrating LoRA and QLoRA into Transformer Models
por: Seregina, Irina, et al.
Publicado: (2025)

Beyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA
por: Chen, Jinqian, et al.
Publicado: (2026)

Origin Tracer: A Method for Detecting LoRA Fine-Tuning Origins in LLMs
por: Liang, Hongyu, et al.
Publicado: (2025)

Convergence Analysis of Aggregation-Broadcast in LoRA-enabled Distributed Fine-Tuning
por: Chen, Xin, et al.
Publicado: (2025)

$α$-LoRA: Effective Fine-Tuning via Base Model Rescaling
por: Firdoussi, Aymane El, et al.
Publicado: (2025)

Understanding the Learning Dynamics of LoRA: A Gradient Flow Perspective on Low-Rank Adaptation in Matrix Factorization
por: Xu, Ziqing, et al.
Publicado: (2025)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
por: Wang, Zhengbo, et al.
Publicado: (2024)

SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
por: Zhou, Kaiye, et al.
Publicado: (2024)

Learning Rate Scaling across LoRA Ranks and Transfer to Full Finetuning
por: Chen, Nan, et al.
Publicado: (2026)

LoRA-Mini : Adaptation Matrices Decomposition and Selective Training
por: Singh, Ayush, et al.
Publicado: (2024)

FedALT: Federated Fine-Tuning through Adaptive Local Training with Rest-of-World LoRA
por: Bian, Jieming, et al.
Publicado: (2025)

SC-LoRA: Balancing Efficient Fine-tuning and Knowledge Preservation via Subspace-Constrained LoRA
por: Luo, Minrui, et al.
Publicado: (2025)

LoRA-Mixer: Coordinate Modular LoRA Experts Through Serial Attention Routing
por: Li, Wenbing, et al.
Publicado: (2025)

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
por: Zhang, Ruiyi, et al.
Publicado: (2024)