FedRD: Reducing Divergences for Generalized Federated Learning via Heterogeneity-aware Parameter Guidance

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Kaile, Cao, Jiannong, Yang, Yu, Li, Xiaoyin, Zhang, Mingjin
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915758774157312
author Wang, Kaile
Cao, Jiannong
Yang, Yu
Li, Xiaoyin
Zhang, Mingjin
author_facet Wang, Kaile
Cao, Jiannong
Yang, Yu
Li, Xiaoyin
Zhang, Mingjin
contents Heterogeneous federated learning (HFL) aims to ensure effective and privacy-preserving collaboration among different entities. As newly joined clients require significant adjustments and additional training to align with the existing system, the problem of generalizing federated learning models to unseen clients under heterogeneous data has become progressively crucial. Consequently, we highlight two unsolved challenging issues in federated domain generalization: Optimization Divergence and Performance Divergence. To tackle the above challenges, we propose FedRD, a novel heterogeneity-aware federated learning algorithm that collaboratively utilizes parameter-guided global generalization aggregation and local debiased classification to reduce divergences, aiming to obtain an optimal global model for participating and unseen clients. Extensive experiments on public multi-domain datasets demonstrate that our approach exhibits a substantial performance advantage over competing baselines in addressing this specific problem.
format Preprint
id arxiv_https___arxiv_org_abs_2601_20397
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle FedRD: Reducing Divergences for Generalized Federated Learning via Heterogeneity-aware Parameter Guidance
Wang, Kaile
Cao, Jiannong
Yang, Yu
Li, Xiaoyin
Zhang, Mingjin
Machine Learning
Artificial Intelligence
Heterogeneous federated learning (HFL) aims to ensure effective and privacy-preserving collaboration among different entities. As newly joined clients require significant adjustments and additional training to align with the existing system, the problem of generalizing federated learning models to unseen clients under heterogeneous data has become progressively crucial. Consequently, we highlight two unsolved challenging issues in federated domain generalization: Optimization Divergence and Performance Divergence. To tackle the above challenges, we propose FedRD, a novel heterogeneity-aware federated learning algorithm that collaboratively utilizes parameter-guided global generalization aggregation and local debiased classification to reduce divergences, aiming to obtain an optimal global model for participating and unseen clients. Extensive experiments on public multi-domain datasets demonstrate that our approach exhibits a substantial performance advantage over competing baselines in addressing this specific problem.
title FedRD: Reducing Divergences for Generalized Federated Learning via Heterogeneity-aware Parameter Guidance
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2601.20397