Byzantine-Resilient Over-the-Air Federated Learning under Zero-Trust Architecture

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yao, Jiacheng, Shi, Wei, Xu, Wei, Yang, Zhaohui, Swindlehurst, A. Lee, Niyato, Dusit
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910890101571584
author Yao, Jiacheng
Shi, Wei
Xu, Wei
Yang, Zhaohui
Swindlehurst, A. Lee
Niyato, Dusit
author_facet Yao, Jiacheng
Shi, Wei
Xu, Wei
Yang, Zhaohui
Swindlehurst, A. Lee
Niyato, Dusit
contents Over-the-air computation (AirComp) has emerged as an essential approach for enabling communication-efficient federated learning (FL) over wireless networks. Nonetheless, the inherent analog transmission mechanism in AirComp-based FL (AirFL) intensifies challenges posed by potential Byzantine attacks. In this paper, we propose a novel Byzantine-robust FL paradigm for over-the-air transmissions, referred to as federated learning with secure adaptive clustering (FedSAC). FedSAC aims to protect a portion of the devices from attacks through zero trust architecture (ZTA) based Byzantine identification and adaptive device clustering. By conducting a one-step convergence analysis, we theoretically characterize the convergence behavior with different device clustering mechanisms and uneven aggregation weighting factors for each device. Building upon our analytical results, we formulate a joint optimization problem for the clustering and weighting factors in each communication round. To facilitate the targeted optimization, we propose a dynamic Byzantine identification method using historical reputation based on ZTA. Furthermore, we introduce a sequential clustering method, transforming the joint optimization into a weighting optimization problem without sacrificing the optimality. To optimize the weighting, we capitalize on the penalty convex-concave procedure (P-CCP) to obtain a stationary solution. Numerical results substantiate the superiority of the proposed FedSAC over existing methods in terms of both test accuracy and convergence rate.
format Preprint
id arxiv_https___arxiv_org_abs_2503_18284
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Byzantine-Resilient Over-the-Air Federated Learning under Zero-Trust Architecture
Yao, Jiacheng
Shi, Wei
Xu, Wei
Yang, Zhaohui
Swindlehurst, A. Lee
Niyato, Dusit
Information Theory
Machine Learning
Over-the-air computation (AirComp) has emerged as an essential approach for enabling communication-efficient federated learning (FL) over wireless networks. Nonetheless, the inherent analog transmission mechanism in AirComp-based FL (AirFL) intensifies challenges posed by potential Byzantine attacks. In this paper, we propose a novel Byzantine-robust FL paradigm for over-the-air transmissions, referred to as federated learning with secure adaptive clustering (FedSAC). FedSAC aims to protect a portion of the devices from attacks through zero trust architecture (ZTA) based Byzantine identification and adaptive device clustering. By conducting a one-step convergence analysis, we theoretically characterize the convergence behavior with different device clustering mechanisms and uneven aggregation weighting factors for each device. Building upon our analytical results, we formulate a joint optimization problem for the clustering and weighting factors in each communication round. To facilitate the targeted optimization, we propose a dynamic Byzantine identification method using historical reputation based on ZTA. Furthermore, we introduce a sequential clustering method, transforming the joint optimization into a weighting optimization problem without sacrificing the optimality. To optimize the weighting, we capitalize on the penalty convex-concave procedure (P-CCP) to obtain a stationary solution. Numerical results substantiate the superiority of the proposed FedSAC over existing methods in terms of both test accuracy and convergence rate.
title Byzantine-Resilient Over-the-Air Federated Learning under Zero-Trust Architecture
topic Information Theory
Machine Learning
url https://arxiv.org/abs/2503.18284