Revisit the Stability of Vanilla Federated Learning Under Diverse Conditions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lee, Youngjoon, Gong, Jinu, Choi, Sun, Kang, Joonhyuk
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909514604740608
author Lee, Youngjoon
Gong, Jinu
Choi, Sun
Kang, Joonhyuk
author_facet Lee, Youngjoon
Gong, Jinu
Choi, Sun
Kang, Joonhyuk
contents Federated Learning (FL) is a distributed machine learning paradigm enabling collaborative model training across decentralized clients while preserving data privacy. In this paper, we revisit the stability of the vanilla FedAvg algorithm under diverse conditions. Despite its conceptual simplicity, FedAvg exhibits remarkably stable performance compared to more advanced FL techniques. Our experiments assess the performance of various FL methods on blood cell and skin lesion classification tasks using Vision Transformer (ViT). Additionally, we evaluate the impact of different representative classification models and analyze sensitivity to hyperparameter variations. The results consistently demonstrate that, regardless of dataset, classification model employed, or hyperparameter settings, FedAvg maintains robust performance. Given its stability, robust performance without the need for extensive hyperparameter tuning, FedAvg is a safe and efficient choice for FL deployments in resource-constrained hospitals handling medical data. These findings underscore the enduring value of the vanilla FedAvg approach as a trusted baseline for clinical practice.
format Preprint
id arxiv_https___arxiv_org_abs_2502_19849
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Revisit the Stability of Vanilla Federated Learning Under Diverse Conditions
Lee, Youngjoon
Gong, Jinu
Choi, Sun
Kang, Joonhyuk
Machine Learning
Federated Learning (FL) is a distributed machine learning paradigm enabling collaborative model training across decentralized clients while preserving data privacy. In this paper, we revisit the stability of the vanilla FedAvg algorithm under diverse conditions. Despite its conceptual simplicity, FedAvg exhibits remarkably stable performance compared to more advanced FL techniques. Our experiments assess the performance of various FL methods on blood cell and skin lesion classification tasks using Vision Transformer (ViT). Additionally, we evaluate the impact of different representative classification models and analyze sensitivity to hyperparameter variations. The results consistently demonstrate that, regardless of dataset, classification model employed, or hyperparameter settings, FedAvg maintains robust performance. Given its stability, robust performance without the need for extensive hyperparameter tuning, FedAvg is a safe and efficient choice for FL deployments in resource-constrained hospitals handling medical data. These findings underscore the enduring value of the vanilla FedAvg approach as a trusted baseline for clinical practice.
title Revisit the Stability of Vanilla Federated Learning Under Diverse Conditions
topic Machine Learning
url https://arxiv.org/abs/2502.19849