Lightweight Federated Learning in Mobile Edge Computing with Statistical and Device Heterogeneity Awareness

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Tan, Jinghong, Zhang, Zhichen, Guo, Kun, Chang, Tsung-Hui, Quek, Tony Q. S.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908618988716032
author Tan, Jinghong
Zhang, Zhichen
Guo, Kun
Chang, Tsung-Hui
Quek, Tony Q. S.
author_facet Tan, Jinghong
Zhang, Zhichen
Guo, Kun
Chang, Tsung-Hui
Quek, Tony Q. S.
contents Federated learning enables collaborative machine learning while preserving data privacy, but high communication and computation costs, exacerbated by statistical and device heterogeneity, limit its practicality in mobile edge computing. Existing compression methods like sparsification and pruning reduce per-round costs but may increase training rounds and thus the total training cost, especially under heterogeneous environments. We propose a lightweight personalized FL framework built on parameter decoupling, which separates the model into shared and private subspaces, enabling us to uniquely apply gradient sparsification to the shared component and model pruning to the private one. This structural separation confines communication compression to global knowledge exchange and computation reduction to local personalization, protecting personalization quality while adapting to heterogeneous client resources. We theoretically analyze convergence under the combined effects of sparsification and pruning, revealing a sparsity-pruning trade-off that links to the iteration complexity. Guided by this analysis, we formulate a joint optimization that selects per-client sparsity and pruning rates and wireless bandwidth to reduce end-to-end training time. Simulation results demonstrate faster convergence and substantial reductions in overall communication and computation costs with negligible accuracy loss, validating the benefits of coordinated and resource-aware personalization in resource-constrained heterogeneous environments.
format Preprint
id arxiv_https___arxiv_org_abs_2510_25342
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Lightweight Federated Learning in Mobile Edge Computing with Statistical and Device Heterogeneity Awareness
Tan, Jinghong
Zhang, Zhichen
Guo, Kun
Chang, Tsung-Hui
Quek, Tony Q. S.
Systems and Control
Federated learning enables collaborative machine learning while preserving data privacy, but high communication and computation costs, exacerbated by statistical and device heterogeneity, limit its practicality in mobile edge computing. Existing compression methods like sparsification and pruning reduce per-round costs but may increase training rounds and thus the total training cost, especially under heterogeneous environments. We propose a lightweight personalized FL framework built on parameter decoupling, which separates the model into shared and private subspaces, enabling us to uniquely apply gradient sparsification to the shared component and model pruning to the private one. This structural separation confines communication compression to global knowledge exchange and computation reduction to local personalization, protecting personalization quality while adapting to heterogeneous client resources. We theoretically analyze convergence under the combined effects of sparsification and pruning, revealing a sparsity-pruning trade-off that links to the iteration complexity. Guided by this analysis, we formulate a joint optimization that selects per-client sparsity and pruning rates and wireless bandwidth to reduce end-to-end training time. Simulation results demonstrate faster convergence and substantial reductions in overall communication and computation costs with negligible accuracy loss, validating the benefits of coordinated and resource-aware personalization in resource-constrained heterogeneous environments.
title Lightweight Federated Learning in Mobile Edge Computing with Statistical and Device Heterogeneity Awareness
topic Systems and Control
url https://arxiv.org/abs/2510.25342