Imagen de Portada

A Bayesian Interpretation of Adaptive Low-Rank Adaptation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Chen, Haolin, Garner, Philip N.
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation
por: Sengupta, Ayan, et al.
Publicado: (2024)

GoRA: Gradient-driven Adaptive Low Rank Adaptation
por: He, Haonan, et al.
Publicado: (2025)

Alleviating Forgetfulness of Linear Attention by Hybrid Sparse Attention and Contextualized Learnable Token Eviction
por: He, Mutian, et al.
Publicado: (2025)

Bayesian Parameter-Efficient Fine-Tuning for Overcoming Catastrophic Forgetting
por: Chen, Haolin, et al.
Publicado: (2024)

Adaptive Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization
por: Ji, Yixin, et al.
Publicado: (2024)

Bayesian Low-Rank Factorization for Robust Model Adaptation
por: Ugan, Enes Yavuz, et al.
Publicado: (2025)

Interpretable Safety Alignment via SAE-Constructed Low-Rank Subspace Adaptation
por: Wang, Dianyun, et al.
Publicado: (2025)

BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
por: Wang, Yibin, et al.
Publicado: (2024)

MoR: Mixture of Ranks for Low-Rank Adaptation Tuning
por: Tang, Chuanyu, et al.
Publicado: (2024)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
por: Si, Chongjie, et al.
Publicado: (2025)

Contextually Guided Transformers via Low-Rank Adaptation
por: Zhmoginov, Andrey, et al.
Publicado: (2025)

HiP-LoRA: Budgeted Spectral Plasticity for Robust Low-Rank Adaptation
por: Chen, Lixian, et al.
Publicado: (2026)

SARA: Singular-Value Based Adaptive Low-Rank Adaption
por: Gu, Jihao, et al.
Publicado: (2024)

LoRA-GA: Low-Rank Adaptation with Gradient Approximation
por: Wang, Shaowen, et al.
Publicado: (2024)

CSULoRA: Closest Safe Update Low-Rank Adaptation
por: Breneur, Oleksandr Marchenko, et al.
Publicado: (2026)

The Expressive Power of Low-Rank Adaptation
por: Zeng, Yuchen, et al.
Publicado: (2023)

Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptation
por: Li, Shiwei, et al.
Publicado: (2025)

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference
por: Samplawski, Colin, et al.
Publicado: (2025)

OMoE: Diversifying Mixture of Low-Rank Adaptation by Orthogonal Finetuning
por: Feng, Jinyuan, et al.
Publicado: (2025)

Variational Low-Rank Adaptation Using IVON
por: Cong, Bai, et al.
Publicado: (2024)

Batched Low-Rank Adaptation of Foundation Models
por: Wen, Yeming, et al.
Publicado: (2023)

Optimizing Fine-Tuning through Advanced Initialization Strategies for Low-Rank Adaptation
por: Xue, Yongfu
Publicado: (2025)

AFLoRA: Adaptive Freezing of Low Rank Adaptation in Parameter Efficient Fine-Tuning of Large Models
por: Liu, Zeyu, et al.
Publicado: (2024)

LoTR: Low Tensor Rank Weight Adaptation
por: Bershatsky, Daniel, et al.
Publicado: (2024)

LoRMA: Low-Rank Multiplicative Adaptation for LLMs
por: Bihany, Harsh, et al.
Publicado: (2025)

Low-Rank Adaptation for Multilingual Summarization: An Empirical Study
por: Whitehouse, Chenxi, et al.
Publicado: (2023)

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning
por: Rajabzadeh, Hossein, et al.
Publicado: (2024)

DropLoRA: Sparse Low-Rank Adaptation for Parameter-Efficient Fine-Tuning
por: Zhang, Haojie
Publicado: (2025)

CeRA: Overcoming the Linear Ceiling of Low-Rank Adaptation via Capacity Expansion
por: Chen, Hung-Hsuan
Publicado: (2026)

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
por: Yang, Yaming, et al.
Publicado: (2024)

Dynamic Rank Reinforcement Learning for Adaptive Low-Rank Multi-Head Self Attention in Large Language Models
por: Erden, Caner
Publicado: (2025)

SBoRA: Low-Rank Adaptation with Regional Weight Updates
por: Po, Lai-Man, et al.
Publicado: (2024)

LoRA+: Efficient Low Rank Adaptation of Large Models
por: Hayou, Soufiane, et al.
Publicado: (2024)

BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptation
por: Qin, Peijia, et al.
Publicado: (2024)

Not How Many, But Which: Parameter Placement in Low-Rank Adaptation
por: Sehanobish, Arijit, et al.
Publicado: (2026)

FLoE: Fisher-Based Layer Selection for Efficient Sparse Adaptation of Low-Rank Experts
por: Wang, Xinyi, et al.
Publicado: (2025)

LSR-Adapt: Ultra-Efficient Parameter Tuning with Matrix Low Separation Rank Kernel Adaptation
por: Li, Xin, et al.
Publicado: (2025)

SwitchLoRA: Switched Low-Rank Adaptation Can Learn Full-Rank Information
por: Zhou, Kaiye, et al.
Publicado: (2024)

BoRA: Bayesian Hierarchical Low-Rank Adaption for Multi-Task Large Language Models
por: Eide, Simen, et al.
Publicado: (2024)

AdaPreLoRA: Adafactor Preconditioned Low-Rank Adaptation
por: Liu, Ziyun, et al.
Publicado: (2026)