Saved in:
Bibliographic Details
Main Authors: Zhu, Rongyi, Zhang, Zeliang, Liang, Susan, Liu, Zhuo, Xu, Chenliang
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.14077
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911965392142336
author Zhu, Rongyi
Zhang, Zeliang
Liang, Susan
Liu, Zhuo
Xu, Chenliang
author_facet Zhu, Rongyi
Zhang, Zeliang
Liang, Susan
Liu, Zhuo
Xu, Chenliang
contents Adversarial examples, crafted by adding perturbations imperceptible to humans, can deceive neural networks. Recent studies identify the adversarial transferability across various models, \textit{i.e.}, the cross-model attack ability of adversarial samples. To enhance such adversarial transferability, existing input transformation-based methods diversify input data with transformation augmentation. However, their effectiveness is limited by the finite number of available transformations. In our study, we introduce a novel approach named Learning to Transform (L2T). L2T increases the diversity of transformed images by selecting the optimal combination of operations from a pool of candidates, consequently improving adversarial transferability. We conceptualize the selection of optimal transformation combinations as a trajectory optimization problem and employ a reinforcement learning strategy to effectively solve the problem. Comprehensive experiments on the ImageNet dataset, as well as practical tests with Google Vision and GPT-4V, reveal that L2T surpasses current methodologies in enhancing adversarial transferability, thereby confirming its effectiveness and practical significance. The code is available at https://github.com/RongyiZhu/L2T.
format Preprint
id arxiv_https___arxiv_org_abs_2405_14077
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning to Transform Dynamically for Better Adversarial Transferability
Zhu, Rongyi
Zhang, Zeliang
Liang, Susan
Liu, Zhuo
Xu, Chenliang
Computer Vision and Pattern Recognition
Artificial Intelligence
Adversarial examples, crafted by adding perturbations imperceptible to humans, can deceive neural networks. Recent studies identify the adversarial transferability across various models, \textit{i.e.}, the cross-model attack ability of adversarial samples. To enhance such adversarial transferability, existing input transformation-based methods diversify input data with transformation augmentation. However, their effectiveness is limited by the finite number of available transformations. In our study, we introduce a novel approach named Learning to Transform (L2T). L2T increases the diversity of transformed images by selecting the optimal combination of operations from a pool of candidates, consequently improving adversarial transferability. We conceptualize the selection of optimal transformation combinations as a trajectory optimization problem and employ a reinforcement learning strategy to effectively solve the problem. Comprehensive experiments on the ImageNet dataset, as well as practical tests with Google Vision and GPT-4V, reveal that L2T surpasses current methodologies in enhancing adversarial transferability, thereby confirming its effectiveness and practical significance. The code is available at https://github.com/RongyiZhu/L2T.
title Learning to Transform Dynamically for Better Adversarial Transferability
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2405.14077