Flight: A FaaS-Based Framework for Complex and Hierarchical Federated Learning
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913517156696064 |
|---|---|
| author | Hudson, Nathaniel Hayot-Sasson, Valerie Babuji, Yadu Baughman, Matt Pauloski, J. Gregory Chard, Ryan Foster, Ian Chard, Kyle |
| author_facet | Hudson, Nathaniel Hayot-Sasson, Valerie Babuji, Yadu Baughman, Matt Pauloski, J. Gregory Chard, Ryan Foster, Ian Chard, Kyle |
| contents | Federated Learning (FL) is a decentralized machine learning paradigm where models are trained on distributed devices and are aggregated at a central server. Existing FL frameworks assume simple two-tier network topologies where end devices are directly connected to the aggregation server. While this is a practical mental model, it does not exploit the inherent topology of real-world distributed systems like the Internet-of-Things. We present Flight, a novel FL framework that supports complex hierarchical multi-tier topologies, asynchronous aggregation, and decouples the control plane from the data plane. We compare the performance of Flight against Flower, a state-of-the-art FL framework. Our results show that Flight scales beyond Flower, supporting up to 2048 simultaneous devices, and reduces FL makespan across several models. Finally, we show that Flight's hierarchical FL model can reduce communication overheads by more than 60%. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_16495 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Flight: A FaaS-Based Framework for Complex and Hierarchical Federated Learning Hudson, Nathaniel Hayot-Sasson, Valerie Babuji, Yadu Baughman, Matt Pauloski, J. Gregory Chard, Ryan Foster, Ian Chard, Kyle Machine Learning Distributed, Parallel, and Cluster Computing Federated Learning (FL) is a decentralized machine learning paradigm where models are trained on distributed devices and are aggregated at a central server. Existing FL frameworks assume simple two-tier network topologies where end devices are directly connected to the aggregation server. While this is a practical mental model, it does not exploit the inherent topology of real-world distributed systems like the Internet-of-Things. We present Flight, a novel FL framework that supports complex hierarchical multi-tier topologies, asynchronous aggregation, and decouples the control plane from the data plane. We compare the performance of Flight against Flower, a state-of-the-art FL framework. Our results show that Flight scales beyond Flower, supporting up to 2048 simultaneous devices, and reduces FL makespan across several models. Finally, we show that Flight's hierarchical FL model can reduce communication overheads by more than 60%. |
| title | Flight: A FaaS-Based Framework for Complex and Hierarchical Federated Learning |
| topic | Machine Learning Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2409.16495 |