Image de couverture de livre

GraLoRA: Granular Low-Rank Adaptation for Parameter-Efficient Fine-Tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jung, Yeonjoon, Ahn, Daehyun, Kim, Hyungjun, Kim, Taesu, Park, Eunhyeok
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
par: Kim, Taesu, et autres
Publié: (2024)

Rethinking the Rank Threshold for LoRA Fine-Tuning
par: Park, Juneyoung
Publié: (2026)

ARD-LoRA: Dynamic Rank Allocation for Parameter-Efficient Fine-Tuning of Foundation Models with Heterogeneous Adaptation Needs
par: Shinwari, Haseeb Ullah Khan, et autres
Publié: (2025)

Hybrid-LoRA: Bridging Full Fine-Tuning and Low-Rank Adaptation for Post-Training
par: Zhang, Chengqian, et autres
Publié: (2026)

Computational Limits of Low-Rank Adaptation (LoRA) Fine-Tuning for Transformer Models
par: Hu, Jerry Yao-Chieh, et autres
Publié: (2024)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
par: Liu, Zeyu, et autres
Publié: (2024)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
par: Barazandeh, Babak, et autres
Publié: (2025)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
par: Chang, Huandong, et autres
Publié: (2025)

Parameter-Efficient Fine-Tuning for HAR: Integrating LoRA and QLoRA into Transformer Models
par: Seregina, Irina, et autres
Publié: (2025)

LoRA+: Efficient Low Rank Adaptation of Large Models
par: Hayou, Soufiane, et autres
Publié: (2024)

RoRA: Efficient Fine-Tuning of LLM with Reliability Optimization for Rank Adaptation
par: Liu, Jun, et autres
Publié: (2025)

LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
par: Bałazy, Klaudia, et autres
Publié: (2024)

Parameter Efficiency Is Not Memory Efficiency: Rethinking Fine-Tuning for On-Device LLM Adaptation
par: Tenison, Irene, et autres
Publié: (2026)

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
par: Zhang, Ruiyi, et autres
Publié: (2024)

On-the-Fly Adaptation to Quantization: Configuration-Aware LoRA for Efficient Fine-Tuning of Quantized LLMs
par: Ye, Rongguang, et autres
Publié: (2025)

Echo-LoRA: Parameter-Efficient Fine-Tuning via Cross-Layer Representation Injection
par: Peng, Yihang, et autres
Publié: (2026)

Stable-LoRA: Stabilizing Feature Learning of Low-Rank Adaptation
par: Wu, Yize, et autres
Publié: (2026)

LoCA: Location-Aware Cosine Adaptation for Parameter-Efficient Fine-Tuning
par: Du, Zhekai, et autres
Publié: (2025)

TT-LoRA MoE: Unifying Parameter-Efficient Fine-Tuning and Sparse Mixture-of-Experts
par: Kunwar, Pradip, et autres
Publié: (2025)

MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning
par: Modoranu, Ionut-Vlad, et autres
Publié: (2026)

BaLoRA: Bayesian Low-Rank Adaptation of Large Scale Models
par: Coscia, Dario, et autres
Publié: (2026)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
par: Yang, Yifan, et autres
Publié: (2024)

MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning
par: Wang, Maolin, et autres
Publié: (2025)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
par: Zhang, Haojie
Publié: (2025)

mLoRA: Fine-Tuning LoRA Adapters via Highly-Efficient Pipeline Parallelism in Multiple GPUs
par: Ye, Zhengmao, et autres
Publié: (2023)

OWQ: Outlier-Aware Weight Quantization for Efficient Fine-Tuning and Inference of Large Language Models
par: Lee, Changhun, et autres
Publié: (2023)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
par: Yang, Yaming, et autres
Publié: (2024)

AdaPreLoRA: Adafactor Preconditioned Low-Rank Adaptation
par: Liu, Ziyun, et autres
Publié: (2026)

GateRA: Token-Aware Modulation for Parameter-Efficient Fine-Tuning
par: Ou, Jie, et autres
Publié: (2025)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
par: Zhu, Zhanda, et autres
Publié: (2025)

KD-LoRA: A Hybrid Approach to Efficient Fine-Tuning with LoRA and Knowledge Distillation
par: Azimi, Rambod, et autres
Publié: (2024)

LoRA-DA: Data-Aware Initialization for Low-Rank Adaptation via Asymptotic Analysis
par: Zhang, Qingyue, et autres
Publié: (2025)

iLoRA: Bayesian Low-Rank Adaptation with Latent Interaction Graphs for Microbiome Diagnosis
par: Song, Yang, et autres
Publié: (2026)

Laplacian-LoRA: Delaying Oversmoothing in Deep GCNs via Spectral Low-Rank Adaptation
par: Alisetti, Sai Vamsi
Publié: (2026)

TalkLoRA: Communication-Aware Mixture of Low-Rank Adaptation for Large Language Models
par: Mu, Lin, et autres
Publié: (2026)

Adaptive Selection of LoRA Components in Privacy-Preserving Federated Learning
par: Kim, Myoungjun, et autres
Publié: (2026)

SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
par: Zhou, Kaiye, et autres
Publié: (2024)

FedTreeLoRA: Reconciling Statistical and Functional Heterogeneity in Federated LoRA Fine-Tuning
par: Bian, Jieming, et autres
Publié: (2026)

AR1-ZO: Topology-Aware Rank-1 Zeroth-Order Queries for High-Rank LoRA Fine-Tuning
par: Chen, Ziye, et autres
Publié: (2026)

Ravan: Multi-Head Low-Rank Adaptation for Federated Fine-Tuning
par: Raje, Arian, et autres
Publié: (2025)