Approximate Gradient Coding for Privacy-Flexible Federated Learning with Non-IID Data
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866910398542774272 |
|---|---|
| author | Makkonen, Okko Niemelä, Sampo Hollanti, Camilla Hanna, Serge Kas |
| author_facet | Makkonen, Okko Niemelä, Sampo Hollanti, Camilla Hanna, Serge Kas |
| contents | This work focuses on the challenges of non-IID data and stragglers/dropouts in federated learning. We introduce and explore a privacy-flexible paradigm that models parts of the clients' local data as non-private, offering a more versatile and business-oriented perspective on privacy. Within this framework, we propose a data-driven strategy for mitigating the effects of label heterogeneity and client straggling on federated learning. Our solution combines both offline data sharing and approximate gradient coding techniques. Through numerical simulations using the MNIST dataset, we demonstrate that our approach enables achieving a deliberate trade-off between privacy and utility, leading to improved model convergence and accuracy while using an adaptable portion of non-private data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_03524 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Approximate Gradient Coding for Privacy-Flexible Federated Learning with Non-IID Data Makkonen, Okko Niemelä, Sampo Hollanti, Camilla Hanna, Serge Kas Machine Learning Cryptography and Security Distributed, Parallel, and Cluster Computing Information Theory This work focuses on the challenges of non-IID data and stragglers/dropouts in federated learning. We introduce and explore a privacy-flexible paradigm that models parts of the clients' local data as non-private, offering a more versatile and business-oriented perspective on privacy. Within this framework, we propose a data-driven strategy for mitigating the effects of label heterogeneity and client straggling on federated learning. Our solution combines both offline data sharing and approximate gradient coding techniques. Through numerical simulations using the MNIST dataset, we demonstrate that our approach enables achieving a deliberate trade-off between privacy and utility, leading to improved model convergence and accuracy while using an adaptable portion of non-private data. |
| title | Approximate Gradient Coding for Privacy-Flexible Federated Learning with Non-IID Data |
| topic | Machine Learning Cryptography and Security Distributed, Parallel, and Cluster Computing Information Theory |
| url | https://arxiv.org/abs/2404.03524 |