CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2021
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909168017866752 |
|---|---|
| author | Zhang, Yu Duan, Moming Liu, Duo Li, Li Ren, Ao Chen, Xianzhang Tan, Yujuan Wang, Chengliang |
| author_facet | Zhang, Yu Duan, Moming Liu, Duo Li, Li Ren, Ao Chen, Xianzhang Tan, Yujuan Wang, Chengliang |
| contents | Federated learning (FL) is an emerging distributed machine learning paradigm that protects privacy and tackles the problem of isolated data islands. At present, there are two main communication strategies of FL: synchronous FL and asynchronous FL. The advantages of synchronous FL are that the model has high precision and fast convergence speed. However, this synchronous communication strategy has the risk that the central server waits too long for the devices, namely, the straggler effect which has a negative impact on some time-critical applications. Asynchronous FL has a natural advantage in mitigating the straggler effect, but there are threats of model quality degradation and server crash. Therefore, we combine the advantages of these two strategies to propose a clustered semi-asynchronous federated learning (CSAFL) framework. We evaluate CSAFL based on four imbalanced federated datasets in a non-IID setting and compare CSAFL to the baseline methods. The experimental results show that CSAFL significantly improves test accuracy by more than +5% on the four datasets compared to TA-FedAvg. In particular, CSAFL improves absolute test accuracy by +34.4% on non-IID FEMNIST compared to TA-FedAvg. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2104_08184 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework Zhang, Yu Duan, Moming Liu, Duo Li, Li Ren, Ao Chen, Xianzhang Tan, Yujuan Wang, Chengliang Machine Learning Distributed, Parallel, and Cluster Computing Federated learning (FL) is an emerging distributed machine learning paradigm that protects privacy and tackles the problem of isolated data islands. At present, there are two main communication strategies of FL: synchronous FL and asynchronous FL. The advantages of synchronous FL are that the model has high precision and fast convergence speed. However, this synchronous communication strategy has the risk that the central server waits too long for the devices, namely, the straggler effect which has a negative impact on some time-critical applications. Asynchronous FL has a natural advantage in mitigating the straggler effect, but there are threats of model quality degradation and server crash. Therefore, we combine the advantages of these two strategies to propose a clustered semi-asynchronous federated learning (CSAFL) framework. We evaluate CSAFL based on four imbalanced federated datasets in a non-IID setting and compare CSAFL to the baseline methods. The experimental results show that CSAFL significantly improves test accuracy by more than +5% on the four datasets compared to TA-FedAvg. In particular, CSAFL improves absolute test accuracy by +34.4% on non-IID FEMNIST compared to TA-FedAvg. |
| title | CSAFL: A Clustered Semi-Asynchronous Federated Learning Framework |
| topic | Machine Learning Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2104.08184 |