A review on different techniques used to combat the non-IID and heterogeneous nature of data in FL

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteur principal: Iyer, Venkataraman Natarajan
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914626343534592
author Iyer, Venkataraman Natarajan
author_facet Iyer, Venkataraman Natarajan
contents Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs under the supervision of a central server orchestrating the training or via a peer-to-peer network. The significance of FL is particularly pronounced in industries such as healthcare and finance, where data privacy holds paramount importance. However, training a model under the Federated learning setting brings forth several challenges, with one of the most prominent being the heterogeneity of data distribution among the edge devices. The data is typically non-independently and non-identically distributed (non-IID), thereby presenting challenges to model convergence. This report delves into the issues arising from non-IID and heterogeneous data and explores current algorithms designed to address these challenges.
format Preprint
id arxiv_https___arxiv_org_abs_2401_00809
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A review on different techniques used to combat the non-IID and heterogeneous nature of data in FL
Iyer, Venkataraman Natarajan
Machine Learning
Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs under the supervision of a central server orchestrating the training or via a peer-to-peer network. The significance of FL is particularly pronounced in industries such as healthcare and finance, where data privacy holds paramount importance. However, training a model under the Federated learning setting brings forth several challenges, with one of the most prominent being the heterogeneity of data distribution among the edge devices. The data is typically non-independently and non-identically distributed (non-IID), thereby presenting challenges to model convergence. This report delves into the issues arising from non-IID and heterogeneous data and explores current algorithms designed to address these challenges.
title A review on different techniques used to combat the non-IID and heterogeneous nature of data in FL
topic Machine Learning
url https://arxiv.org/abs/2401.00809