Saved in:
Bibliographic Details
Main Authors: Qi, Tianyu, Xue, Lei, Zhan, Yufeng, Ma, Xiaobo
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.05402
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917275040219136
author Qi, Tianyu
Xue, Lei
Zhan, Yufeng
Ma, Xiaobo
author_facet Qi, Tianyu
Xue, Lei
Zhan, Yufeng
Ma, Xiaobo
contents The growing use of large pre-trained models in edge computing has made model inference on mobile clients both feasible and popular. Yet these devices remain vulnerable to adversarial attacks, threatening model robustness and security. Federated adversarial training (FAT) offers a promising solution by enhancing robustness while preserving client privacy. However, FAT often yields a generalized global model that struggles with heterogeneous client data, leading to limited personalization and significant communication overhead. In this paper, we propose \textit{Lorica}, a personalized synergistic adversarial training framework that delivers customized defense models through a two-phase process. In Phase 1, \textit{Lorica} applies LoRA-FA for local adversarial fine-tuning, enabling personalized robustness while reducing communication by uploading only LoRA-FA parameters. In Phase 2, a forward-gating selection strategy improves benign accuracy, further refining the personalized model. This yields tailored defense models that effectively balance robustness and accuracy. Extensive experiments on benchmark datasets demonstrate that \textit{Lorica} can achieve up to 68$\times$ improvements in communication efficiency compared to state-of-the-art algorithms, while achieving up to 29.9\% and 52.2\% enhancements in adversarial robustness and benign accuracy, respectively.
format Preprint
id arxiv_https___arxiv_org_abs_2506_05402
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Lorica: A Synergistic Fine-Tuning Framework for Advancing Personalized Adversarial Robustness
Qi, Tianyu
Xue, Lei
Zhan, Yufeng
Ma, Xiaobo
Cryptography and Security
Machine Learning
The growing use of large pre-trained models in edge computing has made model inference on mobile clients both feasible and popular. Yet these devices remain vulnerable to adversarial attacks, threatening model robustness and security. Federated adversarial training (FAT) offers a promising solution by enhancing robustness while preserving client privacy. However, FAT often yields a generalized global model that struggles with heterogeneous client data, leading to limited personalization and significant communication overhead. In this paper, we propose \textit{Lorica}, a personalized synergistic adversarial training framework that delivers customized defense models through a two-phase process. In Phase 1, \textit{Lorica} applies LoRA-FA for local adversarial fine-tuning, enabling personalized robustness while reducing communication by uploading only LoRA-FA parameters. In Phase 2, a forward-gating selection strategy improves benign accuracy, further refining the personalized model. This yields tailored defense models that effectively balance robustness and accuracy. Extensive experiments on benchmark datasets demonstrate that \textit{Lorica} can achieve up to 68$\times$ improvements in communication efficiency compared to state-of-the-art algorithms, while achieving up to 29.9\% and 52.2\% enhancements in adversarial robustness and benign accuracy, respectively.
title Lorica: A Synergistic Fine-Tuning Framework for Advancing Personalized Adversarial Robustness
topic Cryptography and Security
Machine Learning
url https://arxiv.org/abs/2506.05402