Benchmarking Data Heterogeneity Evaluation Approaches for Personalized Federated Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912089230016512 |
|---|---|
| author | Li, Zhilong Wu, Xiaohu Tang, Xiaoli He, Tiantian Ong, Yew-Soon Chen, Mengmeng Liu, Qiqi Lao, Qicheng Yu, Han |
| author_facet | Li, Zhilong Wu, Xiaohu Tang, Xiaoli He, Tiantian Ong, Yew-Soon Chen, Mengmeng Liu, Qiqi Lao, Qicheng Yu, Han |
| contents | There is growing research interest in measuring the statistical heterogeneity of clients' local datasets. Such measurements are used to estimate the suitability for collaborative training of personalized federated learning (PFL) models. Currently, these research endeavors are taking place in silos and there is a lack of a unified benchmark to provide a fair and convenient comparison among various approaches in common settings. We aim to bridge this important gap in this paper. The proposed benchmarking framework currently includes six representative approaches. Extensive experiments have been conducted to compare these approaches under five standard non-IID FL settings, providing much needed insights into which approaches are advantageous under which settings. The proposed framework offers useful guidance on the suitability of various data divergence measures in FL systems. It is beneficial for keeping related research activities on the right track in terms of: (1) designing PFL schemes, (2) selecting appropriate data heterogeneity evaluation approaches for specific FL application scenarios, and (3) addressing fairness issues in collaborative model training. The code is available at https://github.com/Xiaoni-61/DH-Benchmark. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_07286 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Benchmarking Data Heterogeneity Evaluation Approaches for Personalized Federated Learning Li, Zhilong Wu, Xiaohu Tang, Xiaoli He, Tiantian Ong, Yew-Soon Chen, Mengmeng Liu, Qiqi Lao, Qicheng Yu, Han Machine Learning Artificial Intelligence There is growing research interest in measuring the statistical heterogeneity of clients' local datasets. Such measurements are used to estimate the suitability for collaborative training of personalized federated learning (PFL) models. Currently, these research endeavors are taking place in silos and there is a lack of a unified benchmark to provide a fair and convenient comparison among various approaches in common settings. We aim to bridge this important gap in this paper. The proposed benchmarking framework currently includes six representative approaches. Extensive experiments have been conducted to compare these approaches under five standard non-IID FL settings, providing much needed insights into which approaches are advantageous under which settings. The proposed framework offers useful guidance on the suitability of various data divergence measures in FL systems. It is beneficial for keeping related research activities on the right track in terms of: (1) designing PFL schemes, (2) selecting appropriate data heterogeneity evaluation approaches for specific FL application scenarios, and (3) addressing fairness issues in collaborative model training. The code is available at https://github.com/Xiaoni-61/DH-Benchmark. |
| title | Benchmarking Data Heterogeneity Evaluation Approaches for Personalized Federated Learning |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2410.07286 |