PFedDST: Personalized Federated Learning with Decentralized Selection Training

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Fan, Mengchen, Li, Keren, Zhang, Tianyun, Tian, Qing, Geng, Baocheng
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929719912431616
author Fan, Mengchen
Li, Keren
Zhang, Tianyun
Tian, Qing
Geng, Baocheng
author_facet Fan, Mengchen
Li, Keren
Zhang, Tianyun
Tian, Qing
Geng, Baocheng
contents Distributed Learning (DL) enables the training of machine learning models across multiple devices, yet it faces challenges like non-IID data distributions and device capability disparities, which can impede training efficiency. Communication bottlenecks further complicate traditional Federated Learning (FL) setups. To mitigate these issues, we introduce the Personalized Federated Learning with Decentralized Selection Training (PFedDST) framework. PFedDST enhances model training by allowing devices to strategically evaluate and select peers based on a comprehensive communication score. This score integrates loss, task similarity, and selection frequency, ensuring optimal peer connections. This selection strategy is tailored to increase local personalization and promote beneficial peer collaborations to strengthen the stability and efficiency of the training process. Our experiments demonstrate that PFedDST not only enhances model accuracy but also accelerates convergence. This approach outperforms state-of-the-art methods in handling data heterogeneity, delivering both faster and more effective training in diverse and decentralized systems.
format Preprint
id arxiv_https___arxiv_org_abs_2502_07750
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PFedDST: Personalized Federated Learning with Decentralized Selection Training
Fan, Mengchen
Li, Keren
Zhang, Tianyun
Tian, Qing
Geng, Baocheng
Machine Learning
Artificial Intelligence
Distributed Learning (DL) enables the training of machine learning models across multiple devices, yet it faces challenges like non-IID data distributions and device capability disparities, which can impede training efficiency. Communication bottlenecks further complicate traditional Federated Learning (FL) setups. To mitigate these issues, we introduce the Personalized Federated Learning with Decentralized Selection Training (PFedDST) framework. PFedDST enhances model training by allowing devices to strategically evaluate and select peers based on a comprehensive communication score. This score integrates loss, task similarity, and selection frequency, ensuring optimal peer connections. This selection strategy is tailored to increase local personalization and promote beneficial peer collaborations to strengthen the stability and efficiency of the training process. Our experiments demonstrate that PFedDST not only enhances model accuracy but also accelerates convergence. This approach outperforms state-of-the-art methods in handling data heterogeneity, delivering both faster and more effective training in diverse and decentralized systems.
title PFedDST: Personalized Federated Learning with Decentralized Selection Training
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2502.07750