Cover Image

LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhang, Qingyue, Chu, Chang, Peng, Tianren, Li, Qi, Luo, Xiangyang, Jiang, Zhihao, Huang, Shao-Lun
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ID-LoRA: Efficient Low-Rank Adaptation Inspired by Matrix Interpolative Decomposition
by: Ma, Xindian, et al.
Published: (2026)

CL-LoRA: Continual Low-Rank Adaptation for Rehearsal-Free Class-Incremental Learning
by: He, Jiangpeng, et al.
Published: (2025)

$D^2LoRA$: Data-Driven LoRA Initialization for Low Resource Tasks
by: SeraJ, Javad, et al.
Published: (2025)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
by: Yang, Yaming, et al.
Published: (2024)

Null-LoRA: Low-Rank Adaptation on Null Space
by: Zhang, Yi, et al.
Published: (2025)

LoRA-GA: Low-Rank Adaptation with Gradient Approximation
by: Wang, Shaowen, et al.
Published: (2024)

LoRA+: Efficient Low Rank Adaptation of Large Models
by: Hayou, Soufiane, et al.
Published: (2024)

Unified Optimization of Source Weights and Transfer Quantities in Multi-Source Transfer Learning: An Asymptotic Framework
by: Zhang, Qingyue, et al.
Published: (2026)

PeriodicLoRA: Breaking the Low-Rank Bottleneck in LoRA Optimization
by: Meng, Xiangdi, et al.
Published: (2024)

Stable-LoRA: Stabilizing Feature Learning of Low-Rank Adaptation
by: Wu, Yize, et al.
Published: (2026)

1LoRA: Summation Compression for Very Low-Rank Adaptation
by: Quercia, Alessio, et al.
Published: (2025)

QuAILoRA: Quantization-Aware Initialization for LoRA
by: Lawton, Neal, et al.
Published: (2024)

Flat-LoRA: Low-Rank Adaptation over a Flat Loss Landscape
by: Li, Tao, et al.
Published: (2024)

HRP: High-Rank Preheating for Superior LoRA Initialization
by: Chen, Yuzhu, et al.
Published: (2025)

BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models
by: Chang, Yupeng, et al.
Published: (2024)

SD-LoRA: Scalable Decoupled Low-Rank Adaptation for Class Incremental Learning
by: Wu, Yichen, et al.
Published: (2025)

Bayesian-LoRA: Probabilistic Low-Rank Adaptation of Large Language Models
by: Lin, Moule, et al.
Published: (2026)

C-LoRA: Continual Low-Rank Adaptation for Pre-trained Models
by: Zhang, Xin, et al.
Published: (2025)

LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
by: Bałazy, Klaudia, et al.
Published: (2024)

Bernoulli-LoRA: A Theoretical Framework for Randomized Low-Rank Adaptation
by: Sokolov, Igor, et al.
Published: (2025)

Beyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA
by: Chen, Jinqian, et al.
Published: (2026)

RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization
by: Liu, Dongqi, et al.
Published: (2024)

LoRA-MGPO: Mitigating Double Descent in Low-Rank Adaptation via Momentum-Guided Perturbation Optimization
by: Chang, Yupeng, et al.
Published: (2025)

LoRA-FA: Efficient and Effective Low Rank Representation Fine-tuning
by: Zhang, Longteng, et al.
Published: (2023)

LoRA-FAIR: Federated LoRA Fine-Tuning with Aggregation and Initialization Refinement
by: Bian, Jieming, et al.
Published: (2024)

Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
by: Hu, Jerry Yao-Chieh, et al.
Published: (2024)

HiP-LoRA: Budgeted Spectral Plasticity for Robust Low-Rank Adaptation
by: Chen, Lixian, et al.
Published: (2026)

PC-LoRA: Low-Rank Adaptation for Progressive Model Compression with Knowledge Distillation
by: Hwang, Injoon, et al.
Published: (2024)

ABM-LoRA: Activation Boundary Matching for Fast Convergence in Low-Rank Adaptation
by: Lee, Dongha, et al.
Published: (2025)

CTR-LoRA: Curvature-Aware and Trust-Region Guided Low-Rank Adaptation for Large Language Models
by: Wang, Zhuxuanzi, et al.
Published: (2025)

Sub-Token Routing in LoRA for Adaptation and Query-Aware KV Compression
by: Jiang, Wei, et al.
Published: (2026)

Recover-LoRA: Data-Free Accuracy Recovery of Degraded Language Models via Low-Rank Adaptation
by: Das, Devleena, et al.
Published: (2025)

AuroRA: Breaking Low-Rank Bottleneck of LoRA with Nonlinear Mapping
by: Dong, Haonan, et al.
Published: (2025)

D2-LoRA: A Synergistic Approach to Differential and Directional Low-Rank Adaptation
by: Fujisawa, Nozomu, et al.
Published: (2026)

Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
by: Zhang, Chengqian, et al.
Published: (2026)

Online-LoRA: Task-free Online Continual Learning via Low Rank Adaptation
by: Wei, Xiwen, et al.
Published: (2024)

C-LoRA: Contextual Low-Rank Adaptation for Uncertainty Estimation in Large Language Models
by: Rahmati, Amir Hossein, et al.
Published: (2025)

Laplacian-LoRA: Delaying Oversmoothing in Deep GCNs via Spectral Low-Rank Adaptation
by: Alisetti, Sai Vamsi
Published: (2026)

UIR-LoRA: Achieving Universal Image Restoration through Multiple Low-Rank Adaptation
by: Zhang, Cheng, et al.
Published: (2024)

Randomized Asymmetric Chain of LoRA: The First Meaningful Theoretical Framework for Low-Rank Adaptation
by: Malinovsky, Grigory, et al.
Published: (2024)