Copertina

Stabilizing Decentralized Federated Fine-Tuning via Topology-Aware Alternating LoRA

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wang, Xiaoyu, Li, Xiaotian, Zhou, Zhixiang, Li, Chen, Liu, Yong
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

ADF-LoRA: Alternating Low-Rank Aggregation for Decentralized Federated Fine-Tuning
di: Wang, Xiaoyu, et al.
Pubblicazione: (2025)

pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
di: Yi, Liping, et al.
Pubblicazione: (2023)

Robust Federated Finetuning of Foundation Models via Alternating Minimization of LoRA
di: Chen, Shuangyi, et al.
Pubblicazione: (2024)

Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients
di: Zhang, Zikai, et al.
Pubblicazione: (2024)

Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
di: Zhang, Zikai, et al.
Pubblicazione: (2025)

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models
di: Cho, Yae Jee, et al.
Pubblicazione: (2024)

Federated LoRA with Sparse Communication
di: Kuo, Kevin, et al.
Pubblicazione: (2024)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
di: Zhu, Zhanda, et al.
Pubblicazione: (2025)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
di: Zuo, Jingwei, et al.
Pubblicazione: (2026)

FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA
di: Jhunjhunwala, Divyansh, et al.
Pubblicazione: (2025)

Improving LoRA in Privacy-preserving Federated Learning
di: Sun, Youbang, et al.
Pubblicazione: (2024)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
di: Sheng, Ying, et al.
Pubblicazione: (2023)

SHE-LoRA: Selective Homomorphic Encryption for Federated Tuning with Heterogeneous LoRA
di: Liu, Jianmin, et al.
Pubblicazione: (2025)

JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning
di: Tahir, Anique, et al.
Pubblicazione: (2024)

ServerlessLoRA: Minimizing Latency and Cost in Serverless Inference for LoRA-Based LLMs
di: Sui, Yifan, et al.
Pubblicazione: (2025)

RBLA: Rank-Based-LoRA-Aggregation for Fine-tuning Heterogeneous Models in FLaaS
di: Chen, Shuaijun, et al.
Pubblicazione: (2024)

HAFLQ: Heterogeneous Adaptive Federated LoRA Fine-tuned LLM with Quantization
di: Su, Yang, et al.
Pubblicazione: (2024)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
di: Li, Rukuo, et al.
Pubblicazione: (2025)

Decentralized Federated Learning with Model Caching on Mobile Agents
di: Wang, Xiaoyu, et al.
Pubblicazione: (2024)

AutoRank: MCDA Based Rank Personalization for LoRA-Enabled Distributed Learning
di: Chen, Shuaijun, et al.
Pubblicazione: (2024)

FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning
di: QI, Jiaxing, et al.
Pubblicazione: (2024)

Rate-My-LoRA: Efficient and Adaptive Federated Model Tuning for Cardiac MRI Segmentation
di: He, Xiaoxiao, et al.
Pubblicazione: (2025)

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations
di: Wang, Ziyao, et al.
Pubblicazione: (2024)

Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning
di: Singhal, Raghav, et al.
Pubblicazione: (2025)

ForkKV: Scaling Multi-LoRA Agent Serving via Copy-on-Write Disaggregated KV Cache
di: Wang, Shao, et al.
Pubblicazione: (2026)

LoRA-C: Parameter-Efficient Fine-Tuning of Robust CNN for IoT Devices
di: Ding, Chuntao, et al.
Pubblicazione: (2024)

SplitLoRA: A Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
di: Lin, Zheng, et al.
Pubblicazione: (2024)

CLLoRA: An Approach to Measure the Effects of the Context Length for LLM Fine-Tuning
di: Zhang, Ping, et al.
Pubblicazione: (2025)

InfiniLoRA: Disaggregated Multi-LoRA Serving for Large Language Models
di: Chen, Hongyu, et al.
Pubblicazione: (2026)

Efficient Multi-Adapter LLM Serving via Cross-Model KV-Cache Reuse with Activated LoRA
di: Li, Allison, et al.
Pubblicazione: (2025)

Exploring Selective Layer Fine-Tuning in Federated Learning
di: Sun, Yuchang, et al.
Pubblicazione: (2024)

Serving Heterogeneous LoRA Adapters in Distributed LLM Inference Systems
di: Jaiswal, Shashwat, et al.
Pubblicazione: (2025)

EcoLoRA: Communication-Efficient Federated Fine-Tuning of Large Language Models
di: Liu, Han, et al.
Pubblicazione: (2025)

Communication-Efficient Federated Fine-Tuning
di: Theologitis, Michael, et al.
Pubblicazione: (2025)

FedMoE-DA: Federated Mixture of Experts via Domain Aware Fine-grained Aggregation
di: Zhan, Ziwei, et al.
Pubblicazione: (2024)

Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Models
di: Wang, Ziyao, et al.
Pubblicazione: (2024)

Co-LoRA: Collaborative Model Personalization on Heterogeneous Multi-Modal Clients
di: Seo, Minhyuk, et al.
Pubblicazione: (2025)

HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
di: Lin, Zheng, et al.
Pubblicazione: (2025)

CaraServe: CPU-Assisted and Rank-Aware LoRA Serving for Generative LLM Inference
di: Li, Suyi, et al.
Pubblicazione: (2024)

SplitFT: An Adaptive Federated Split Learning System For LLMs Fine-Tuning
di: Shan, Yimeng, et al.
Pubblicazione: (2026)