Copertina

GoRA: Gradient-driven Adaptive Low Rank Adaptation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	He, Haonan, Ye, Peng, Ren, Yuchen, Yuan, Yuan, Zhou, Luyang, Ju, Shucun, Chen, Lei
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

PRILoRA: Pruned and Rank-Increasing Low-Rank Adaptation
di: Benedek, Nadav, et al.
Pubblicazione: (2024)

TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition
di: Lin, Tianwei, et al.
Pubblicazione: (2024)

The Expressive Power of Low-Rank Adaptation
di: Zeng, Yuchen, et al.
Pubblicazione: (2023)

SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
di: Zhou, Kaiye, et al.
Pubblicazione: (2024)

DenseLoRA: Dense Low-Rank Adaptation of Large Language Models
di: Mu, Lin, et al.
Pubblicazione: (2025)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
di: Lin, Weicheng, et al.
Pubblicazione: (2026)

SBoRA: Low-Rank Adaptation with Regional Weight Updates
di: Po, Lai-Man, et al.
Pubblicazione: (2024)

LoRA+: Efficient Low Rank Adaptation of Large Models
di: Hayou, Soufiane, et al.
Pubblicazione: (2024)

TriAdaptLoRA: Brain-Inspired Triangular Adaptive Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
di: Liang, Yao, et al.
Pubblicazione: (2025)

TsqLoRA: Towards Sensitivity and Quality Low-Rank Adaptation for Efficient Fine-Tuning
di: Chen, Yu, et al.
Pubblicazione: (2025)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
di: Yang, Yaming, et al.
Pubblicazione: (2024)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
di: Liu, Zeyu, et al.
Pubblicazione: (2024)

CeRA: Overcoming the Linear Ceiling of Low-Rank Adaptation via Capacity Expansion
di: Chen, Hung-Hsuan
Pubblicazione: (2026)

AdaPreLoRA: Adafactor Preconditioned Low-Rank Adaptation
di: Liu, Ziyun, et al.
Pubblicazione: (2026)

Adaptive GoGI-Skip: Coupling Goal-Gradient Importance with Dynamic Uncertainty for Efficient Reasoning
di: Zhuang, Ren
Pubblicazione: (2025)

LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
di: Bałazy, Klaudia, et al.
Pubblicazione: (2024)

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
di: Zhang, Ruiyi, et al.
Pubblicazione: (2024)

MSPLoRA: A Multi-Scale Pyramid Low-Rank Adaptation for Efficient Model Fine-Tuning
di: Zhao, Jiancheng, et al.
Pubblicazione: (2025)

CoRA: Optimizing Low-Rank Adaptation with Common Subspace of Large Language Models
di: Xiao, Xiaojun, et al.
Pubblicazione: (2024)

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models
di: Lu, Yuheng, et al.
Pubblicazione: (2024)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
di: Wang, Zhengbo, et al.
Pubblicazione: (2024)

EDoRA: Efficient Weight-Decomposed Low-Rank Adaptation via Singular Value Decomposition
di: Nasiri, Hamid, et al.
Pubblicazione: (2025)

Flexora: Flexible Low Rank Adaptation for Large Language Models
di: Wei, Chenxing, et al.
Pubblicazione: (2024)

ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation
di: Song, Yurun, et al.
Pubblicazione: (2024)

Matrix-Transformation Based Low-Rank Adaptation (MTLoRA): A Brain-Inspired Method for Parameter-Efficient Fine-Tuning
di: Liang, Yao, et al.
Pubblicazione: (2024)

RST-LoRA: A Discourse-Aware Low-Rank Adaptation for Long Document Abstractive Summarization
di: Liu, Dongqi, et al.
Pubblicazione: (2024)

ResLoRA: Identity Residual Mapping in Low-Rank Adaption
di: Shi, Shuhua, et al.
Pubblicazione: (2024)

GeoRA: Geometry-Aware Low-Rank Adaptation for RLVR
di: Zhang, Jiaying, et al.
Pubblicazione: (2026)

Recover-LoRA: Data-Free Accuracy Recovery of Degraded Language Models via Low-Rank Adaptation
di: Das, Devleena, et al.
Pubblicazione: (2025)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
di: Tang, Chuanyu, et al.
Pubblicazione: (2024)

ASLoRA: Adaptive Sharing Low-Rank Adaptation Across Layers
di: Hu, Junyan, et al.
Pubblicazione: (2024)

Less is More: Resource-Efficient Low-Rank Adaptation
di: Tian, Chunlin, et al.
Pubblicazione: (2025)

Enhancing Low-Rank Adaptation with Structured Nonlinear Transformations
di: Deng, Guanzhi, et al.
Pubblicazione: (2025)

EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation
di: Liu, Shih-Yang, et al.
Pubblicazione: (2024)

DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models
di: Deng, Guanzhi, et al.
Pubblicazione: (2026)

Beyond LoRA vs. Full Fine-Tuning: Gradient-Guided Optimizer Routing for LLM Adaptation
di: Tang, Haozhan, et al.
Pubblicazione: (2026)

zFLoRA: Zero-Latency Fused Low-Rank Adapters
di: Gowda, Dhananjaya, et al.
Pubblicazione: (2025)

LoRA on the Go: Instance-level Dynamic LoRA Selection and Merging
di: Lee, Seungeon, et al.
Pubblicazione: (2025)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
di: Chang, Huandong, et al.
Pubblicazione: (2025)

Batched Low-Rank Adaptation of Foundation Models
di: Wen, Yeming, et al.
Pubblicazione: (2023)