Scheduling and Aggregation Design for Asynchronous Federated Learning over Wireless Networks
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2022
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917120112066560 |
|---|---|
| author | Hu, Chung-Hsuan Chen, Zheng Larsson, Erik G. |
| author_facet | Hu, Chung-Hsuan Chen, Zheng Larsson, Erik G. |
| contents | Federated Learning (FL) is a collaborative machine learning (ML) framework that combines on-device training and server-based aggregation to train a common ML model among distributed agents. In this work, we propose an asynchronous FL design with periodic aggregation to tackle the straggler issue in FL systems. Considering limited wireless communication resources, we investigate the effect of different scheduling policies and aggregation designs on the convergence performance. Driven by the importance of reducing the bias and variance of the aggregated model updates, we propose a scheduling policy that jointly considers the channel quality and training data representation of user devices. The effectiveness of our channel-aware data-importance-based scheduling policy, compared with state-of-the-art methods proposed for synchronous FL, is validated through simulations. Moreover, we show that an ``age-aware'' aggregation weighting design can significantly improve the learning performance in an asynchronous FL setting. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2212_07356 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Scheduling and Aggregation Design for Asynchronous Federated Learning over Wireless Networks Hu, Chung-Hsuan Chen, Zheng Larsson, Erik G. Machine Learning Distributed, Parallel, and Cluster Computing Information Theory Signal Processing Federated Learning (FL) is a collaborative machine learning (ML) framework that combines on-device training and server-based aggregation to train a common ML model among distributed agents. In this work, we propose an asynchronous FL design with periodic aggregation to tackle the straggler issue in FL systems. Considering limited wireless communication resources, we investigate the effect of different scheduling policies and aggregation designs on the convergence performance. Driven by the importance of reducing the bias and variance of the aggregated model updates, we propose a scheduling policy that jointly considers the channel quality and training data representation of user devices. The effectiveness of our channel-aware data-importance-based scheduling policy, compared with state-of-the-art methods proposed for synchronous FL, is validated through simulations. Moreover, we show that an ``age-aware'' aggregation weighting design can significantly improve the learning performance in an asynchronous FL setting. |
| title | Scheduling and Aggregation Design for Asynchronous Federated Learning over Wireless Networks |
| topic | Machine Learning Distributed, Parallel, and Cluster Computing Information Theory Signal Processing |
| url | https://arxiv.org/abs/2212.07356 |