Image de couverture de livre

Fed-pilot: Optimizing LoRA Allocation for Efficient Federated Fine-Tuning with Heterogeneous Clients

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Zikai, Hu, Rui, Liu, Ping, Xu, Jiahao
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Distributed, Parallel, and Cluster Computing
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Fed-HeLLo: Efficient Federated Foundation Model Fine-Tuning with Heterogeneous LoRA Allocation
par: Zhang, Zikai, et autres
Publié: (2025)

pFedLoRA: Model-Heterogeneous Personalized Federated Learning with LoRA Tuning
par: Yi, Liping, et autres
Publié: (2023)

Heterogeneous Federated Fine-Tuning with Parallel One-Rank Adaptation
par: Zhang, Zikai, et autres
Publié: (2026)

Heterogeneous LoRA for Federated Fine-tuning of On-Device Foundation Models
par: Cho, Yae Jee, et autres
Publié: (2024)

FedQuad: Adaptive Layer-wise LoRA Deployment and Activation Quantization for Federated Fine-Tuning
par: Li, Rukuo, et autres
Publié: (2025)

FedRA: A Random Allocation Strategy for Federated Tuning to Unleash the Power of Heterogeneous Clients
par: Su, Shangchao, et autres
Publié: (2023)

SHE-LoRA: Selective Homomorphic Encryption for Federated Tuning with Heterogeneous LoRA
par: Liu, Jianmin, et autres
Publié: (2025)

Stabilizing Decentralized Federated Fine-Tuning via Topology-Aware Alternating LoRA
par: Wang, Xiaoyu, et autres
Publié: (2026)

LoRAFusion: Efficient LoRA Fine-Tuning for LLMs
par: Zhu, Zhanda, et autres
Publié: (2025)

ALTO: Adaptive LoRA Tuning and Orchestration for Heterogeneous LoRA Training Workloads
par: Zuo, Jingwei, et autres
Publié: (2026)

FedRPCA: Enhancing Federated LoRA Aggregation Using Robust PCA
par: Jhunjhunwala, Divyansh, et autres
Publié: (2025)

Federated LoRA with Sparse Communication
par: Kuo, Kevin, et autres
Publié: (2024)

FedHFT: Efficient Federated Finetuning with Heterogeneous Edge Clients
par: Ilhan, Fatih, et autres
Publié: (2025)

LoRA-C: Parameter-Efficient Fine-Tuning of Robust CNN for IoT Devices
par: Ding, Chuntao, et autres
Publié: (2024)

HAFLQ: Heterogeneous Adaptive Federated LoRA Fine-tuned LLM with Quantization
par: Su, Yang, et autres
Publié: (2024)

Co-LoRA: Collaborative Model Personalization on Heterogeneous Multi-Modal Clients
par: Seo, Minhyuk, et autres
Publié: (2025)

RBLA: Rank-Based-LoRA-Aggregation for Fine-tuning Heterogeneous Models in FLaaS
par: Chen, Shuaijun, et autres
Publié: (2024)

HLoRA: Efficient Federated Learning System for LLM Heterogeneous Fine-Tuning
par: Liu, Qianli, et autres
Publié: (2025)

EcoLoRA: Communication-Efficient Federated Fine-Tuning of Large Language Models
par: Liu, Han, et autres
Publié: (2025)

Identify Backdoored Model in Federated Learning via Individual Unlearning
par: Xu, Jiahao, et autres
Publié: (2024)

FedEx-LoRA: Exact Aggregation for Federated and Efficient Fine-Tuning of Foundation Models
par: Singhal, Raghav, et autres
Publié: (2024)

Detecting Backdoor Attacks in Federated Learning via Direction Alignment Inspection
par: Xu, Jiahao, et autres
Publié: (2025)

Fed-SB: A Silver Bullet for Extreme Communication Efficiency and Performance in (Private) Federated LoRA Fine-Tuning
par: Singhal, Raghav, et autres
Publié: (2025)

Achieving Byzantine-Resilient Federated Learning via Layer-Adaptive Sparsified Model Aggregation
par: Xu, Jiahao, et autres
Publié: (2024)

JORA: JAX Tensor-Parallel LoRA Library for Retrieval Augmented Fine-Tuning
par: Tahir, Anique, et autres
Publié: (2024)

FDLoRA: Personalized Federated Learning of Large Language Model via Dual LoRA Tuning
par: QI, Jiaxing, et autres
Publié: (2024)

ServerlessLoRA: Minimizing Latency and Cost in Serverless Inference for LoRA-Based LLMs
par: Sui, Yifan, et autres
Publié: (2025)

S-LoRA: Serving Thousands of Concurrent LoRA Adapters
par: Sheng, Ying, et autres
Publié: (2023)

Robust Federated Finetuning of Foundation Models via Alternating Minimization of LoRA
par: Chen, Shuangyi, et autres
Publié: (2024)

Rate-My-LoRA: Efficient and Adaptive Federated Model Tuning for Cardiac MRI Segmentation
par: He, Xiaoxiao, et autres
Publié: (2025)

Improving LoRA in Privacy-preserving Federated Learning
par: Sun, Youbang, et autres
Publié: (2024)

FLoRA: Federated Fine-Tuning Large Language Models with Heterogeneous Low-Rank Adaptations
par: Wang, Ziyao, et autres
Publié: (2024)

FedCAda: Adaptive Client-Side Optimization for Accelerated and Stable Federated Learning
par: Zhou, Liuzhi, et autres
Publié: (2024)

ADF-LoRA: Alternating Low-Rank Aggregation for Decentralized Federated Fine-Tuning
par: Wang, Xiaoyu, et autres
Publié: (2025)

CLLoRA: An Approach to Measure the Effects of the Context Length for LLM Fine-Tuning
par: Zhang, Ping, et autres
Publié: (2025)

InfiniLoRA: Disaggregated Multi-LoRA Serving for Large Language Models
par: Chen, Hongyu, et autres
Publié: (2026)

HSplitLoRA: A Heterogeneous Split Parameter-Efficient Fine-Tuning Framework for Large Language Models
par: Lin, Zheng, et autres
Publié: (2025)

Serving Heterogeneous LoRA Adapters in Distributed LLM Inference Systems
par: Jaiswal, Shashwat, et autres
Publié: (2025)

FedClust: Optimizing Federated Learning on Non-IID Data through Weight-Driven Client Clustering
par: Islam, Md Sirajul, et autres
Publié: (2024)

FedCompass: Efficient Cross-Silo Federated Learning on Heterogeneous Client Devices using a Computing Power Aware Scheduler
par: Li, Zilinghan, et autres
Publié: (2023)