On the Impact of Data Heterogeneity in Federated Learning Environments with Application to Healthcare Networks

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Milasheuski, Usevalad, Barbieri, Luca, Tedeschini, Bernardo Camajori, Nicoli, Monica, Savazzi, Stefano
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913491775913984
author Milasheuski, Usevalad
Barbieri, Luca
Tedeschini, Bernardo Camajori
Nicoli, Monica
Savazzi, Stefano
author_facet Milasheuski, Usevalad
Barbieri, Luca
Tedeschini, Bernardo Camajori
Nicoli, Monica
Savazzi, Stefano
contents Federated Learning (FL) allows multiple privacy-sensitive applications to leverage their dataset for a global model construction without any disclosure of the information. One of those domains is healthcare, where groups of silos collaborate in order to generate a global predictor with improved accuracy and generalization. However, the inherent challenge lies in the high heterogeneity of medical data, necessitating sophisticated techniques for assessment and compensation. This paper presents a comprehensive exploration of the mathematical formalization and taxonomy of heterogeneity within FL environments, focusing on the intricacies of medical data. In particular, we address the evaluation and comparison of the most popular FL algorithms with respect to their ability to cope with quantity-based, feature and label distribution-based heterogeneity. The goal is to provide a quantitative evaluation of the impact of data heterogeneity in FL systems for healthcare networks as well as a guideline on FL algorithm selection. Our research extends beyond existing studies by benchmarking seven of the most common FL algorithms against the unique challenges posed by medical data use cases. The paper targets the prediction of the risk of stroke recurrence through a set of tabular clinical reports collected by different federated hospital silos: data heterogeneity frequently encountered in this scenario and its impact on FL performance are discussed.
format Preprint
id arxiv_https___arxiv_org_abs_2404_18519
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On the Impact of Data Heterogeneity in Federated Learning Environments with Application to Healthcare Networks
Milasheuski, Usevalad
Barbieri, Luca
Tedeschini, Bernardo Camajori
Nicoli, Monica
Savazzi, Stefano
Machine Learning
Artificial Intelligence
Federated Learning (FL) allows multiple privacy-sensitive applications to leverage their dataset for a global model construction without any disclosure of the information. One of those domains is healthcare, where groups of silos collaborate in order to generate a global predictor with improved accuracy and generalization. However, the inherent challenge lies in the high heterogeneity of medical data, necessitating sophisticated techniques for assessment and compensation. This paper presents a comprehensive exploration of the mathematical formalization and taxonomy of heterogeneity within FL environments, focusing on the intricacies of medical data. In particular, we address the evaluation and comparison of the most popular FL algorithms with respect to their ability to cope with quantity-based, feature and label distribution-based heterogeneity. The goal is to provide a quantitative evaluation of the impact of data heterogeneity in FL systems for healthcare networks as well as a guideline on FL algorithm selection. Our research extends beyond existing studies by benchmarking seven of the most common FL algorithms against the unique challenges posed by medical data use cases. The paper targets the prediction of the risk of stroke recurrence through a set of tabular clinical reports collected by different federated hospital silos: data heterogeneity frequently encountered in this scenario and its impact on FL performance are discussed.
title On the Impact of Data Heterogeneity in Federated Learning Environments with Application to Healthcare Networks
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2404.18519