Image de couverture de livre

LSR-Adapt: Ultra-Efficient Parameter Tuning with Matrix Low Separation Rank Kernel Adaptation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Xin, Sarwate, Anand
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
par: Zhang, Haojie
Publié: (2025)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
par: Liu, Zeyu, et autres
Publié: (2024)

LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
par: Yang, Yifan, et autres
Publié: (2024)

AutoLoRA: Automatically Tuning Matrix Ranks in Low-Rank Adaptation Based on Meta Learning
par: Zhang, Ruiyi, et autres
Publié: (2024)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
par: Tang, Chuanyu, et autres
Publié: (2024)

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning
par: Rajabzadeh, Hossein, et autres
Publié: (2024)

LASERS: LAtent Space Encoding for Representations with Sparsity for Generative Modeling
par: Li, Xin, et autres
Publié: (2024)

Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptation
par: Li, Shiwei, et autres
Publié: (2025)

Optimizing Fine-Tuning through Advanced Initialization Strategies for Low-Rank Adaptation
par: Xue, Yongfu
Publié: (2025)

MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
par: Jiang, Ting, et autres
Publié: (2024)

Not How Many, But Which: Parameter Placement in Low-Rank Adaptation
par: Sehanobish, Arijit, et autres
Publié: (2026)

Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation
par: Sengupta, Ayan, et autres
Publié: (2024)

Efficient Minimum Bayes Risk Decoding using Low-Rank Matrix Completion Algorithms
par: Trabelsi, Firas, et autres
Publié: (2024)

LoRA-XS: Low-Rank Adaptation with Extremely Small Number of Parameters
par: Bałazy, Klaudia, et autres
Publié: (2024)

LoRA-GA: Low-Rank Adaptation with Gradient Approximation
par: Wang, Shaowen, et autres
Publié: (2024)

Unraveling the Localized Latents: Learning Stratified Manifold Structures in LLM Embedding Space with Sparse Mixture-of-Experts
par: Li, Xin, et autres
Publié: (2025)

LoRA+: Efficient Low Rank Adaptation of Large Models
par: Hayou, Soufiane, et autres
Publié: (2024)

LoPT: Low-Rank Prompt Tuning for Parameter Efficient Language Models
par: Guo, Shouchang, et autres
Publié: (2024)

ElaLoRA: Elastic & Learnable Low-Rank Adaptation for Efficient Model Fine-Tuning
par: Chang, Huandong, et autres
Publié: (2025)

FLoE: Fisher-Based Layer Selection for Efficient Sparse Adaptation of Low-Rank Experts
par: Wang, Xinyi, et autres
Publié: (2025)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
par: Si, Chongjie, et autres
Publié: (2025)

Contextually Guided Transformers via Low-Rank Adaptation
par: Zhmoginov, Andrey, et autres
Publié: (2025)

A Bayesian Interpretation of Adaptive Low-Rank Adaptation
par: Chen, Haolin, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning via Circular Convolution
par: Chen, Aochuan, et autres
Publié: (2024)

OMoE: Diversifying Mixture of Low-Rank Adaptation by Orthogonal Finetuning
par: Feng, Jinyuan, et autres
Publié: (2025)

RoSA: Accurate Parameter-Efficient Fine-Tuning via Robust Adaptation
par: Nikdan, Mahdi, et autres
Publié: (2024)

Adapting Large Language Models for Parameter-Efficient Log Anomaly Detection
par: Lim, Ying Fu, et autres
Publié: (2025)

LoRA-SP: Streamlined Partial Parameter Adaptation for Resource-Efficient Fine-Tuning of Large Language Models
par: Wu, Yichao, et autres
Publié: (2024)

CSULoRA: Closest Safe Update Low-Rank Adaptation
par: Breneur, Oleksandr Marchenko, et autres
Publié: (2026)

The Expressive Power of Low-Rank Adaptation
par: Zeng, Yuchen, et autres
Publié: (2023)

Parameter-Efficient Routed Fine-Tuning: Mixture-of-Experts Demands Mixture of Adaptation Modules
par: Liu, Yilun, et autres
Publié: (2025)

PEANuT: Parameter-Efficient Adaptation with Weight-aware Neural Tweakers
par: Zhong, Yibo, et autres
Publié: (2024)

FLuRKA: Fast and accurate unified Low-Rank & Kernel Attention
par: Gupta, Ahan, et autres
Publié: (2023)

Batched Low-Rank Adaptation of Foundation Models
par: Wen, Yeming, et autres
Publié: (2023)

Variational Low-Rank Adaptation Using IVON
par: Cong, Bai, et autres
Publié: (2024)

SMoA: Spectrum Modulation Adapter for Parameter-Efficient Fine-Tuning
par: Liu, Yongkang, et autres
Publié: (2026)

Challenges in Adapting Multilingual LLMs to Low-Resource Languages using LoRA PEFT Tuning
par: Khade, Omkar, et autres
Publié: (2024)

Parameter-Efficient Fine-Tuning of State Space Models
par: Galim, Kevin, et autres
Publié: (2024)

Localized LoRA: A Structured Low-Rank Approximation for Efficient Fine-Tuning
par: Barazandeh, Babak, et autres
Publié: (2025)

A Single Linear Layer Yields Task-Adapted Low-Rank Matrices
par: Kim, Hwichan, et autres
Publié: (2024)