Imagen de Portada

Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Onal, Emre, Flöge, Klemens, Caldwell, Emma, Sheverdin, Arsen, Fortuin, Vincent
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Stein Variational Newton Neural Network Ensembles
por: Flöge, Klemens, et al.
Publicado: (2024)

Scalable Bayesian Low-Rank Adaptation of Large Language Models via Stochastic Variational Subspace Inference
por: Samplawski, Colin, et al.
Publicado: (2025)

BLoB: Bayesian Low-Rank Adaptation by Backpropagation for Large Language Models
por: Wang, Yibin, et al.
Publicado: (2024)

OLoRA: Orthonormal Low-Rank Adaptation of Large Language Models
por: Büyükakyüz, Kerim
Publicado: (2024)

Derivative-Free Optimization for Low-Rank Adaptation in Large Language Models
por: Jin, Feihu, et al.
Publicado: (2024)

Flexora: Flexible Low Rank Adaptation for Large Language Models
por: Wei, Chenxing, et al.
Publicado: (2024)

Gated Integration of Low-Rank Adaptation for Continual Learning of Large Language Models
por: Liang, Yan-Shuo, et al.
Publicado: (2025)

NLoRA: Nyström-Initiated Low-Rank Adaptation for Large Language Models
por: Guo, Chenlu, et al.
Publicado: (2025)

Dual Decomposition of Weights and Singular Value Low Rank Adaptation
por: Han, Jialong, et al.
Publicado: (2025)

LoRTA: Low Rank Tensor Adaptation of Large Language Models
por: Hounie, Ignacio, et al.
Publicado: (2024)

DoRA: Weight-Decomposed Low-Rank Adaptation
por: Liu, Shih-Yang, et al.
Publicado: (2024)

ALoRA: Allocating Low-Rank Adaptation for Fine-tuning Large Language Models
por: Liu, Zequan, et al.
Publicado: (2024)

Astra: Activation-Space Tail-Eigenvector Low-Rank Adaptation of Large Language Models
por: Liu, Kainan, et al.
Publicado: (2026)

MAP: Revisiting Weight Decomposition for Low-Rank Adaptation
por: Si, Chongjie, et al.
Publicado: (2025)

BoRA: Bi-dimensional Weight-Decomposed Low-Rank Adaptation
por: Wang, Qiushi, et al.
Publicado: (2024)

DenseLoRA: Dense Low-Rank Adaptation of Large Language Models
por: Mu, Lin, et al.
Publicado: (2025)

TLoRA: Task-aware Low Rank Adaptation of Large Language Models
por: Lin, Weicheng, et al.
Publicado: (2026)

A Bayesian Interpretation of Adaptive Low-Rank Adaptation
por: Chen, Haolin, et al.
Publicado: (2024)

Bayesian Low-Rank Factorization for Robust Model Adaptation
por: Ugan, Enes Yavuz, et al.
Publicado: (2025)

Bridging the Bosphorus: Advancing Turkish Large Language Models through Strategies for Low-Resource Language Adaptation and Benchmarking
por: Acikgoz, Emre Can, et al.
Publicado: (2024)

LoRS: Efficient Low-Rank Adaptation for Sparse Large Language Model
por: Hu, Yuxuan, et al.
Publicado: (2025)

LoTR: Low Tensor Rank Weight Adaptation
por: Bershatsky, Daniel, et al.
Publicado: (2024)

Training-Free Bayesianization for Low-Rank Adapters of Large Language Models
por: Shi, Haizhou, et al.
Publicado: (2024)

FlexiGPT: Pruning and Extending Large Language Models with Low-Rank Weight Sharing
por: Smith, James Seale, et al.
Publicado: (2025)

Controlled Low-Rank Adaptation with Subspace Regularization for Continued Training on Large Language Models
por: Lu, Yuheng, et al.
Publicado: (2024)

MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning
por: Zhang, Jingfan, et al.
Publicado: (2024)

SBoRA: Low-Rank Adaptation with Regional Weight Updates
por: Po, Lai-Man, et al.
Publicado: (2024)

AdaMoLE: Fine-Tuning Large Language Models with Adaptive Mixture of Low-Rank Adaptation Experts
por: Liu, Zefang, et al.
Publicado: (2024)

Adaptive Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization
por: Ji, Yixin, et al.
Publicado: (2024)

BoRA: Bayesian Hierarchical Low-Rank Adaption for Multi-Task Large Language Models
por: Eide, Simen, et al.
Publicado: (2024)

CoRA: Optimizing Low-Rank Adaptation with Common Subspace of Large Language Models
por: Xiao, Xiaojun, et al.
Publicado: (2024)

LoRA+: Efficient Low Rank Adaptation of Large Models
por: Hayou, Soufiane, et al.
Publicado: (2024)

QDyLoRA: Quantized Dynamic Low-Rank Adaptation for Efficient Large Language Model Tuning
por: Rajabzadeh, Hossein, et al.
Publicado: (2024)

Multimodal Large Language Models with Fusion Low Rank Adaptation for Device Directed Speech Detection
por: Palaskar, Shruti, et al.
Publicado: (2024)

RaSA: Rank-Sharing Low-Rank Adaptation
por: He, Zhiwei, et al.
Publicado: (2025)

Robust and Efficient Fine-tuning of LLMs with Bayesian Reparameterization of Low-Rank Adaptation
por: Sengupta, Ayan, et al.
Publicado: (2024)

BA-LoRA: Bias-Alleviating Low-Rank Adaptation to Mitigate Catastrophic Inheritance in Large Language Models
por: Chang, Yupeng, et al.
Publicado: (2024)

Improving Lean4 Autoformalization via Cycle Consistency Fine-tuning
por: Shebzukhov, Arsen
Publicado: (2026)

CoLA: Collaborative Low-Rank Adaptation
por: Zhou, Yiyun, et al.
Publicado: (2025)

BiDoRA: Bi-level Optimization-Based Weight-Decomposed Low-Rank Adaptation
por: Qin, Peijia, et al.
Publicado: (2024)