Edge Association Strategies for Synthetic Data Empowered Hierarchical Federated Learning with Non-IID Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ng, Jer Shyuan, Kalapaaking, Aditya Pribadi, Xia, Xiaoyu, Niyato, Dusit, Khalil, Ibrahim, Gondal, Iqbal
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909656594513920
author Ng, Jer Shyuan
Kalapaaking, Aditya Pribadi
Xia, Xiaoyu
Niyato, Dusit
Khalil, Ibrahim
Gondal, Iqbal
author_facet Ng, Jer Shyuan
Kalapaaking, Aditya Pribadi
Xia, Xiaoyu
Niyato, Dusit
Khalil, Ibrahim
Gondal, Iqbal
contents In recent years, Federated Learning (FL) has emerged as a widely adopted privacy-preserving distributed training approach, attracting significant interest from both academia and industry. Research efforts have been dedicated to improving different aspects of FL, such as algorithm improvement, resource allocation, and client selection, to enable its deployment in distributed edge networks for practical applications. One of the reasons for the poor FL model performance is due to the worker dropout during training as the FL server may be located far away from the FL workers. To address this issue, an Hierarchical Federated Learning (HFL) framework has been introduced, incorporating an additional layer of edge servers to relay communication between the FL server and workers. While the HFL framework improves the communication between the FL server and workers, large number of communication rounds may still be required for model convergence, particularly when FL workers have non-independent and identically distributed (non-IID) data. Moreover, the FL workers are assumed to fully cooperate in the FL training process, which may not always be true in practical situations. To overcome these challenges, we propose a synthetic-data-empowered HFL framework that mitigates the statistical issues arising from non-IID local datasets while also incentivizing FL worker participation. In our proposed framework, the edge servers reward the FL workers in their clusters for facilitating the FL training process. To improve the performance of the FL model given the non-IID local datasets of the FL workers, the edge servers generate and distribute synthetic datasets to FL workers within their clusters. FL workers determine which edge server to associate with, considering the computational resources required to train on both their local datasets and the synthetic datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2506_18259
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Edge Association Strategies for Synthetic Data Empowered Hierarchical Federated Learning with Non-IID Data
Ng, Jer Shyuan
Kalapaaking, Aditya Pribadi
Xia, Xiaoyu
Niyato, Dusit
Khalil, Ibrahim
Gondal, Iqbal
Distributed, Parallel, and Cluster Computing
In recent years, Federated Learning (FL) has emerged as a widely adopted privacy-preserving distributed training approach, attracting significant interest from both academia and industry. Research efforts have been dedicated to improving different aspects of FL, such as algorithm improvement, resource allocation, and client selection, to enable its deployment in distributed edge networks for practical applications. One of the reasons for the poor FL model performance is due to the worker dropout during training as the FL server may be located far away from the FL workers. To address this issue, an Hierarchical Federated Learning (HFL) framework has been introduced, incorporating an additional layer of edge servers to relay communication between the FL server and workers. While the HFL framework improves the communication between the FL server and workers, large number of communication rounds may still be required for model convergence, particularly when FL workers have non-independent and identically distributed (non-IID) data. Moreover, the FL workers are assumed to fully cooperate in the FL training process, which may not always be true in practical situations. To overcome these challenges, we propose a synthetic-data-empowered HFL framework that mitigates the statistical issues arising from non-IID local datasets while also incentivizing FL worker participation. In our proposed framework, the edge servers reward the FL workers in their clusters for facilitating the FL training process. To improve the performance of the FL model given the non-IID local datasets of the FL workers, the edge servers generate and distribute synthetic datasets to FL workers within their clusters. FL workers determine which edge server to associate with, considering the computational resources required to train on both their local datasets and the synthetic datasets.
title Edge Association Strategies for Synthetic Data Empowered Hierarchical Federated Learning with Non-IID Data
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2506.18259