Reactive Orchestration for Hierarchical Federated Learning Under a Communication Cost Budget
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908339084984320 |
|---|---|
| author | Čilić, Ivan Lackinger, Anna Frangoudis, Pantelis Žarko, Ivana Podnar Furutanpey, Alireza Murturi, Ilir Dustdar, Schahram |
| author_facet | Čilić, Ivan Lackinger, Anna Frangoudis, Pantelis Žarko, Ivana Podnar Furutanpey, Alireza Murturi, Ilir Dustdar, Schahram |
| contents | Deploying a Hierarchical Federated Learning (HFL) pipeline across the computing continuum (CC) requires careful organization of participants into a hierarchical structure with intermediate aggregation nodes between FL clients and the global FL server. This is challenging to achieve due to (i) cost constraints, (ii) varying data distributions, and (iii) the volatile operating environment of the CC. In response to these challenges, we present a framework for the adaptive orchestration of HFL pipelines, designed to be reactive to client churn and infrastructure-level events, while balancing communication cost and ML model accuracy. Our mechanisms identify and react to events that cause HFL reconfiguration actions at runtime, building on multi-level monitoring information (model accuracy, resource availability, resource cost). Moreover, our framework introduces a generic methodology for estimating reconfiguration costs to continuously re-evaluate the quality of adaptation actions, while being extensible to optimize for various HFL performance criteria. By extending the Kubernetes ecosystem, our framework demonstrates the ability to react promptly and effectively to changes in the operating environment, making the best of the available communication cost budget and effectively balancing costs and ML performance at runtime. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_03385 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Reactive Orchestration for Hierarchical Federated Learning Under a Communication Cost Budget Čilić, Ivan Lackinger, Anna Frangoudis, Pantelis Žarko, Ivana Podnar Furutanpey, Alireza Murturi, Ilir Dustdar, Schahram Distributed, Parallel, and Cluster Computing Machine Learning Networking and Internet Architecture Deploying a Hierarchical Federated Learning (HFL) pipeline across the computing continuum (CC) requires careful organization of participants into a hierarchical structure with intermediate aggregation nodes between FL clients and the global FL server. This is challenging to achieve due to (i) cost constraints, (ii) varying data distributions, and (iii) the volatile operating environment of the CC. In response to these challenges, we present a framework for the adaptive orchestration of HFL pipelines, designed to be reactive to client churn and infrastructure-level events, while balancing communication cost and ML model accuracy. Our mechanisms identify and react to events that cause HFL reconfiguration actions at runtime, building on multi-level monitoring information (model accuracy, resource availability, resource cost). Moreover, our framework introduces a generic methodology for estimating reconfiguration costs to continuously re-evaluate the quality of adaptation actions, while being extensible to optimize for various HFL performance criteria. By extending the Kubernetes ecosystem, our framework demonstrates the ability to react promptly and effectively to changes in the operating environment, making the best of the available communication cost budget and effectively balancing costs and ML performance at runtime. |
| title | Reactive Orchestration for Hierarchical Federated Learning Under a Communication Cost Budget |
| topic | Distributed, Parallel, and Cluster Computing Machine Learning Networking and Internet Architecture |
| url | https://arxiv.org/abs/2412.03385 |