Detecting Backdoor Attacks in Federated Learning via Direction Alignment Inspection

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Xu, Jiahao, Zhang, Zikai, Hu, Rui
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908274041815040
author Xu, Jiahao
Zhang, Zikai
Hu, Rui
author_facet Xu, Jiahao
Zhang, Zikai
Hu, Rui
contents The distributed nature of training makes Federated Learning (FL) vulnerable to backdoor attacks, where malicious model updates aim to compromise the global model's performance on specific tasks. Existing defense methods show limited efficacy as they overlook the inconsistency between benign and malicious model updates regarding both general and fine-grained directions. To fill this gap, we introduce AlignIns, a novel defense method designed to safeguard FL systems against backdoor attacks. AlignIns looks into the direction of each model update through a direction alignment inspection process. Specifically, it examines the alignment of model updates with the overall update direction and analyzes the distribution of the signs of their significant parameters, comparing them with the principle sign across all model updates. Model updates that exhibit an unusual degree of alignment are considered malicious and thus be filtered out. We provide the theoretical analysis of the robustness of AlignIns and its propagation error in FL. Our empirical results on both independent and identically distributed (IID) and non-IID datasets demonstrate that AlignIns achieves higher robustness compared to the state-of-the-art defense methods. The code is available at https://github.com/JiiahaoXU/AlignIns.
format Preprint
id arxiv_https___arxiv_org_abs_2503_07978
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Detecting Backdoor Attacks in Federated Learning via Direction Alignment Inspection
Xu, Jiahao
Zhang, Zikai
Hu, Rui
Machine Learning
Cryptography and Security
Distributed, Parallel, and Cluster Computing
The distributed nature of training makes Federated Learning (FL) vulnerable to backdoor attacks, where malicious model updates aim to compromise the global model's performance on specific tasks. Existing defense methods show limited efficacy as they overlook the inconsistency between benign and malicious model updates regarding both general and fine-grained directions. To fill this gap, we introduce AlignIns, a novel defense method designed to safeguard FL systems against backdoor attacks. AlignIns looks into the direction of each model update through a direction alignment inspection process. Specifically, it examines the alignment of model updates with the overall update direction and analyzes the distribution of the signs of their significant parameters, comparing them with the principle sign across all model updates. Model updates that exhibit an unusual degree of alignment are considered malicious and thus be filtered out. We provide the theoretical analysis of the robustness of AlignIns and its propagation error in FL. Our empirical results on both independent and identically distributed (IID) and non-IID datasets demonstrate that AlignIns achieves higher robustness compared to the state-of-the-art defense methods. The code is available at https://github.com/JiiahaoXU/AlignIns.
title Detecting Backdoor Attacks in Federated Learning via Direction Alignment Inspection
topic Machine Learning
Cryptography and Security
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2503.07978