Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wu, Wenyuan, Liu, Zheng, Chen, Yong, Su, Chao, Peng, Dezhong, Wang, Xu
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915169815232512
author Wu, Wenyuan
Liu, Zheng
Chen, Yong
Su, Chao
Peng, Dezhong
Wang, Xu
author_facet Wu, Wenyuan
Liu, Zheng
Chen, Yong
Su, Chao
Peng, Dezhong
Wang, Xu
contents In recent years, the rapid development of deep neural networks has brought increased attention to the security and robustness of these models. While existing adversarial attack algorithms have demonstrated success in improving adversarial transferability, their performance remains suboptimal due to a lack of consideration for the discrepancies between target and source models. To address this limitation, we propose a novel method, Inverse Knowledge Distillation (IKD), designed to enhance adversarial transferability effectively. IKD introduces a distillation-inspired loss function that seamlessly integrates with gradient-based attack methods, promoting diversity in attack gradients and mitigating overfitting to specific model architectures. By diversifying gradients, IKD enables the generation of adversarial samples with superior generalization capabilities across different models, significantly enhancing their effectiveness in black-box attack scenarios. Extensive experiments on the ImageNet dataset validate the effectiveness of our approach, demonstrating substantial improvements in the transferability and attack success rates of adversarial samples across a wide range of models.
format Preprint
id arxiv_https___arxiv_org_abs_2502_17003
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
Wu, Wenyuan
Liu, Zheng
Chen, Yong
Su, Chao
Peng, Dezhong
Wang, Xu
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
In recent years, the rapid development of deep neural networks has brought increased attention to the security and robustness of these models. While existing adversarial attack algorithms have demonstrated success in improving adversarial transferability, their performance remains suboptimal due to a lack of consideration for the discrepancies between target and source models. To address this limitation, we propose a novel method, Inverse Knowledge Distillation (IKD), designed to enhance adversarial transferability effectively. IKD introduces a distillation-inspired loss function that seamlessly integrates with gradient-based attack methods, promoting diversity in attack gradients and mitigating overfitting to specific model architectures. By diversifying gradients, IKD enables the generation of adversarial samples with superior generalization capabilities across different models, significantly enhancing their effectiveness in black-box attack scenarios. Extensive experiments on the ImageNet dataset validate the effectiveness of our approach, demonstrating substantial improvements in the transferability and attack success rates of adversarial samples across a wide range of models.
title Improving the Transferability of Adversarial Examples by Inverse Knowledge Distillation
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.17003