FedClust: Optimizing Federated Learning on Non-IID Data through Weight-Driven Client Clustering
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913256699854848 |
|---|---|
| author | Islam, Md Sirajul Javaherian, Simin Xu, Fei Yuan, Xu Chen, Li Tzeng, Nian-Feng |
| author_facet | Islam, Md Sirajul Javaherian, Simin Xu, Fei Yuan, Xu Chen, Li Tzeng, Nian-Feng |
| contents | Federated learning (FL) is an emerging distributed machine learning paradigm enabling collaborative model training on decentralized devices without exposing their local data. A key challenge in FL is the uneven data distribution across client devices, violating the well-known assumption of independent-and-identically-distributed (IID) training samples in conventional machine learning. Clustered federated learning (CFL) addresses this challenge by grouping clients based on the similarity of their data distributions. However, existing CFL approaches require a large number of communication rounds for stable cluster formation and rely on a predefined number of clusters, thus limiting their flexibility and adaptability. This paper proposes FedClust, a novel CFL approach leveraging correlations between local model weights and client data distributions. FedClust groups clients into clusters in a one-shot manner using strategically selected partial model weights and dynamically accommodates newcomers in real-time. Experimental results demonstrate FedClust outperforms baseline approaches in terms of accuracy and communication costs. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_04144 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FedClust: Optimizing Federated Learning on Non-IID Data through Weight-Driven Client Clustering Islam, Md Sirajul Javaherian, Simin Xu, Fei Yuan, Xu Chen, Li Tzeng, Nian-Feng Distributed, Parallel, and Cluster Computing Machine Learning Federated learning (FL) is an emerging distributed machine learning paradigm enabling collaborative model training on decentralized devices without exposing their local data. A key challenge in FL is the uneven data distribution across client devices, violating the well-known assumption of independent-and-identically-distributed (IID) training samples in conventional machine learning. Clustered federated learning (CFL) addresses this challenge by grouping clients based on the similarity of their data distributions. However, existing CFL approaches require a large number of communication rounds for stable cluster formation and rely on a predefined number of clusters, thus limiting their flexibility and adaptability. This paper proposes FedClust, a novel CFL approach leveraging correlations between local model weights and client data distributions. FedClust groups clients into clusters in a one-shot manner using strategically selected partial model weights and dynamically accommodates newcomers in real-time. Experimental results demonstrate FedClust outperforms baseline approaches in terms of accuracy and communication costs. |
| title | FedClust: Optimizing Federated Learning on Non-IID Data through Weight-Driven Client Clustering |
| topic | Distributed, Parallel, and Cluster Computing Machine Learning |
| url | https://arxiv.org/abs/2403.04144 |