FedCore: Straggler-Free Federated Learning with Distributed Coresets
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910313757016064 |
|---|---|
| author | Guo, Hongpeng Gu, Haotian Wang, Xiaoyang Chen, Bo Lee, Eun Kyung Eilam, Tamar Chen, Deming Nahrstedt, Klara |
| author_facet | Guo, Hongpeng Gu, Haotian Wang, Xiaoyang Chen, Bo Lee, Eun Kyung Eilam, Tamar Chen, Deming Nahrstedt, Klara |
| contents | Federated learning (FL) is a machine learning paradigm that allows multiple clients to collaboratively train a shared model while keeping their data on-premise. However, the straggler issue, due to slow clients, often hinders the efficiency and scalability of FL. This paper presents FedCore, an algorithm that innovatively tackles the straggler problem via the decentralized selection of coresets, representative subsets of a dataset. Contrary to existing centralized coreset methods, FedCore creates coresets directly on each client in a distributed manner, ensuring privacy preservation in FL. FedCore translates the coreset optimization problem into a more tractable k-medoids clustering problem and operates distributedly on each client. Theoretical analysis confirms FedCore's convergence, and practical evaluations demonstrate an 8x reduction in FL training time, without compromising model accuracy. Our extensive evaluations also show that FedCore generalizes well to existing FL frameworks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_00219 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FedCore: Straggler-Free Federated Learning with Distributed Coresets Guo, Hongpeng Gu, Haotian Wang, Xiaoyang Chen, Bo Lee, Eun Kyung Eilam, Tamar Chen, Deming Nahrstedt, Klara Distributed, Parallel, and Cluster Computing Artificial Intelligence Machine Learning Federated learning (FL) is a machine learning paradigm that allows multiple clients to collaboratively train a shared model while keeping their data on-premise. However, the straggler issue, due to slow clients, often hinders the efficiency and scalability of FL. This paper presents FedCore, an algorithm that innovatively tackles the straggler problem via the decentralized selection of coresets, representative subsets of a dataset. Contrary to existing centralized coreset methods, FedCore creates coresets directly on each client in a distributed manner, ensuring privacy preservation in FL. FedCore translates the coreset optimization problem into a more tractable k-medoids clustering problem and operates distributedly on each client. Theoretical analysis confirms FedCore's convergence, and practical evaluations demonstrate an 8x reduction in FL training time, without compromising model accuracy. Our extensive evaluations also show that FedCore generalizes well to existing FL frameworks. |
| title | FedCore: Straggler-Free Federated Learning with Distributed Coresets |
| topic | Distributed, Parallel, and Cluster Computing Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2402.00219 |