Boosting Adversarial Transferability via Commonality-Oriented Gradient Optimization

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gao, Yanting, Liu, Yepeng, Liu, Junming, Zhang, Qi, Zhang, Hongyun, Miao, Duoqian, Zhao, Cairong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911205269962752
author Gao, Yanting
Liu, Yepeng
Liu, Junming
Zhang, Qi
Zhang, Hongyun
Miao, Duoqian
Zhao, Cairong
author_facet Gao, Yanting
Liu, Yepeng
Liu, Junming
Zhang, Qi
Zhang, Hongyun
Miao, Duoqian
Zhao, Cairong
contents Exploring effective and transferable adversarial examples is vital for understanding the characteristics and mechanisms of Vision Transformers (ViTs). However, adversarial examples generated from surrogate models often exhibit weak transferability in black-box settings due to overfitting. Existing methods improve transferability by diversifying perturbation inputs or applying uniform gradient regularization within surrogate models, yet they have not fully leveraged the shared and unique features of surrogate models trained on the same task, leading to suboptimal transfer performance. Therefore, enhancing perturbations of common information shared by surrogate models and suppressing those tied to individual characteristics offers an effective way to improve transferability. Accordingly, we propose a commonality-oriented gradient optimization strategy (COGO) consisting of two components: Commonality Enhancement (CE) and Individuality Suppression (IS). CE perturbs the mid-to-low frequency regions, leveraging the fact that ViTs trained on the same dataset tend to rely more on mid-to-low frequency information for classification. IS employs adaptive thresholds to evaluate the correlation between backpropagated gradients and model individuality, assigning weights to gradients accordingly. Extensive experiments demonstrate that COGO significantly improves the transfer success rates of adversarial attacks, outperforming current state-of-the-art methods.
format Preprint
id arxiv_https___arxiv_org_abs_2506_06992
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Boosting Adversarial Transferability via Commonality-Oriented Gradient Optimization
Gao, Yanting
Liu, Yepeng
Liu, Junming
Zhang, Qi
Zhang, Hongyun
Miao, Duoqian
Zhao, Cairong
Computer Vision and Pattern Recognition
Exploring effective and transferable adversarial examples is vital for understanding the characteristics and mechanisms of Vision Transformers (ViTs). However, adversarial examples generated from surrogate models often exhibit weak transferability in black-box settings due to overfitting. Existing methods improve transferability by diversifying perturbation inputs or applying uniform gradient regularization within surrogate models, yet they have not fully leveraged the shared and unique features of surrogate models trained on the same task, leading to suboptimal transfer performance. Therefore, enhancing perturbations of common information shared by surrogate models and suppressing those tied to individual characteristics offers an effective way to improve transferability. Accordingly, we propose a commonality-oriented gradient optimization strategy (COGO) consisting of two components: Commonality Enhancement (CE) and Individuality Suppression (IS). CE perturbs the mid-to-low frequency regions, leveraging the fact that ViTs trained on the same dataset tend to rely more on mid-to-low frequency information for classification. IS employs adaptive thresholds to evaluate the correlation between backpropagated gradients and model individuality, assigning weights to gradients accordingly. Extensive experiments demonstrate that COGO significantly improves the transfer success rates of adversarial attacks, outperforming current state-of-the-art methods.
title Boosting Adversarial Transferability via Commonality-Oriented Gradient Optimization
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.06992