A review on different techniques used to combat the non-IID and heterogeneous nature of data in FL

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Iyer, Venkataraman Natarajan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914626343534592
author Iyer, Venkataraman Natarajan
author_facet Iyer, Venkataraman Natarajan
contents Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs under the supervision of a central server orchestrating the training or via a peer-to-peer network. The significance of FL is particularly pronounced in industries such as healthcare and finance, where data privacy holds paramount importance. However, training a model under the Federated learning setting brings forth several challenges, with one of the most prominent being the heterogeneity of data distribution among the edge devices. The data is typically non-independently and non-identically distributed (non-IID), thereby presenting challenges to model convergence. This report delves into the issues arising from non-IID and heterogeneous data and explores current algorithms designed to address these challenges.
format Preprint
id arxiv_https___arxiv_org_abs_2401_00809
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A review on different techniques used to combat the non-IID and heterogeneous nature of data in FL
Iyer, Venkataraman Natarajan
Machine Learning
Federated Learning (FL) is a machine-learning approach enabling collaborative model training across multiple decentralized edge devices that hold local data samples, all without exchanging these samples. This collaborative process occurs under the supervision of a central server orchestrating the training or via a peer-to-peer network. The significance of FL is particularly pronounced in industries such as healthcare and finance, where data privacy holds paramount importance. However, training a model under the Federated learning setting brings forth several challenges, with one of the most prominent being the heterogeneity of data distribution among the edge devices. The data is typically non-independently and non-identically distributed (non-IID), thereby presenting challenges to model convergence. This report delves into the issues arising from non-IID and heterogeneous data and explores current algorithms designed to address these challenges.
title A review on different techniques used to combat the non-IID and heterogeneous nature of data in FL
topic Machine Learning
url https://arxiv.org/abs/2401.00809