Image de couverture de livre

Aggregating Low Rank Adapters in Federated Fine-tuning

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Trautmann, Evelyn, Hales, Ian, Volk, Martin F.
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Insights into the Unknown: Federated Data Diversity Analysis on Molecular Data
par: Bujotzek, Markus, et autres
Publié: (2025)

FL-TAC: Enhanced Fine-Tuning in Federated Learning via Low-Rank, Task-Specific Adapter Clustering
par: Ping, Siqi, et autres
Publié: (2024)

Towards Symmetric Low-Rank Adapters
par: Panoutsos, Tales, et autres
Publié: (2025)

MetaLoRA: Tensor-Enhanced Adaptive Low-Rank Fine-tuning
par: Wang, Maolin, et autres
Publié: (2025)

Flora: Low-Rank Adapters Are Secretly Gradient Compressors
par: Hao, Yongchang, et autres
Publié: (2024)

Ensembles of Low-Rank Expert Adapters
par: Li, Yinghao, et autres
Publié: (2025)

Ravan: Multi-Head Low-Rank Adaptation for Federated Fine-Tuning
par: Raje, Arian, et autres
Publié: (2025)

FedHL: Federated Learning for Heterogeneous Low-Rank Adaptation via Unbiased Aggregation
par: Peng, Zihao, et autres
Publié: (2025)

FLoRG: Federated Fine-tuning with Low-rank Gram Matrices and Procrustes Alignment
par: Meng, Chuiyang, et autres
Publié: (2026)

Kron-LoRA: Hybrid Kronecker-LoRA Adapters for Scalable, Sustainable Fine-tuning
par: Shen, Yixin
Publié: (2025)

Beyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA
par: Chen, Jinqian, et autres
Publié: (2026)

Rank Also Matters: Hierarchical Configuration for Mixture of Adapter Experts in LLM Fine-Tuning
par: Cong, Peizhuang, et autres
Publié: (2025)

Sparse High Rank Adapters
par: Bhardwaj, Kartikeya, et autres
Publié: (2024)

LoX: Low-Rank Extrapolation Robustifies LLM Safety Against Fine-tuning
par: Perin, Gabriel J., et autres
Publié: (2025)

Plasticity vs. Rigidity: The Impact of Low-Rank Adapters on Reasoning on a Micro-Budget
par: Khan, Zohaib, et autres
Publié: (2026)

New Insights on Unfolding and Fine-tuning Quantum Federated Learning
par: Nanayakkara, Shanika Iroshi, et autres
Publié: (2025)

Multiple Choice Learning of Low-Rank Adapters for Language Modeling
par: Letzelter, Victor, et autres
Publié: (2025)

LoRA-Pro: Are Low-Rank Adapters Properly Optimized?
par: Wang, Zhengbo, et autres
Publié: (2024)

AdapterTune: Zero-Initialized Low-Rank Adapters for Frozen Vision Transformers
par: Khazem, Salim
Publié: (2026)

SLoPe: Double-Pruned Sparse Plus Lazy Low-Rank Adapter Pretraining of LLMs
par: Mozaffari, Mohammad, et autres
Publié: (2024)

Low-Rank Adapters Meet Neural Architecture Search for LLM Compression
par: Muñoz, J. Pablo, et autres
Publié: (2025)

zFLoRA: Zero-Latency Fused Low-Rank Adapters
par: Gowda, Dhananjaya, et autres
Publié: (2025)

Training-Free Bayesianization for Low-Rank Adapters of Large Language Models
par: Shi, Haizhou, et autres
Publié: (2024)

Spectral Adapter: Fine-Tuning in Spectral Space
par: Zhang, Fangzhao, et autres
Publié: (2024)

Personas within Parameters: Fine-Tuning Small Language Models with Low-Rank Adapters to Mimic User Behaviors
par: Thakur, Himanshu, et autres
Publié: (2025)

PHLoRA: data-free Post-hoc Low-Rank Adapter extraction from full-rank checkpoint
par: Vasani, Bhoomit, et autres
Publié: (2025)

ZorBA: Zeroth-order Federated Fine-tuning of LLMs with Heterogeneous Block Activation
par: Meng, Chuiyang, et autres
Publié: (2026)

BoostLoRA: Growing Effective Rank by Boosting Adapters
par: Anantha, Raviteja, et autres
Publié: (2026)

Polynomial Expansion Rank Adaptation: Enhancing Low-Rank Fine-Tuning with High-Order Interactions
par: Zhang, Wenhao, et autres
Publié: (2026)

PoLAR: Polar-Decomposed Low-Rank Adapter Representation
par: Lion, Kai, et autres
Publié: (2025)

Memory-Efficient Fine-Tuning via Low-Rank Activation Compression
par: Shi, Jiang-Xin, et autres
Publié: (2025)

FALQON: Accelerating LoRA Fine-tuning with Low-Bit Floating-Point Arithmetic
par: Choi, Kanghyun, et autres
Publié: (2025)

Training Neural Networks from Scratch with Parallel Low-Rank Adapters
par: Huh, Minyoung, et autres
Publié: (2024)

Learning Adapter Rank via Symmetry Breaking
par: Doyle, Cooper, et autres
Publié: (2025)

Finer Parameter Steps for Low-Rank PEFT: A Controlled Study with CP Tensor Adapters
par: Wang, Xinjue, et autres
Publié: (2026)

Structured Unrestricted-Rank Matrices for Parameter Efficient Fine-tuning
par: Sehanobish, Arijit, et autres
Publié: (2024)

SDFLoRA: Selective Decoupled Federated LoRA for Privacy-preserving Fine-tuning with Heterogeneous Clients
par: Shen, Zhikang, et autres
Publié: (2026)

Quantized Evolution Strategies: High-precision Fine-tuning of Quantized LLMs at Low-precision Cost
par: Xu, Yinggan, et autres
Publié: (2026)

A Stronger Mixture of Low-Rank Experts for Fine-Tuning Foundation Models
par: Sun, Mengyang, et autres
Publié: (2025)

Deploying Models to Non-participating Clients in Federated Learning without Fine-tuning: A Hypernetwork-based Approach
par: Zhou, Yuhao, et autres
Publié: (2025)