On Transfer-based Universal Attacks in Pure Black-box Setting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jalwana, Mohammad A. A. K., Akhtar, Naveed, Mian, Ajmal, Rahnavard, Nazanin, Shah, Mubarak
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917982860476416
author Jalwana, Mohammad A. A. K.
Akhtar, Naveed
Mian, Ajmal
Rahnavard, Nazanin
Shah, Mubarak
author_facet Jalwana, Mohammad A. A. K.
Akhtar, Naveed
Mian, Ajmal
Rahnavard, Nazanin
Shah, Mubarak
contents Despite their impressive performance, deep visual models are susceptible to transferable black-box adversarial attacks. Principally, these attacks craft perturbations in a target model-agnostic manner. However, surprisingly, we find that existing methods in this domain inadvertently take help from various priors that violate the black-box assumption such as the availability of the dataset used to train the target model, and the knowledge of the number of classes in the target model. Consequently, the literature fails to articulate the true potency of transferable black-box attacks. We provide an empirical study of these biases and propose a framework that aids in a prior-free transparent study of this paradigm. Using our framework, we analyze the role of prior knowledge of the target model data and number of classes in attack performance. We also provide several interesting insights based on our analysis, and demonstrate that priors cause overestimation in transferability scores. Finally, we extend our framework to query-based attacks. This extension inspires a novel image-blending technique to prepare data for effective surrogate model training.
format Preprint
id arxiv_https___arxiv_org_abs_2504_08866
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On Transfer-based Universal Attacks in Pure Black-box Setting
Jalwana, Mohammad A. A. K.
Akhtar, Naveed
Mian, Ajmal
Rahnavard, Nazanin
Shah, Mubarak
Machine Learning
Artificial Intelligence
Despite their impressive performance, deep visual models are susceptible to transferable black-box adversarial attacks. Principally, these attacks craft perturbations in a target model-agnostic manner. However, surprisingly, we find that existing methods in this domain inadvertently take help from various priors that violate the black-box assumption such as the availability of the dataset used to train the target model, and the knowledge of the number of classes in the target model. Consequently, the literature fails to articulate the true potency of transferable black-box attacks. We provide an empirical study of these biases and propose a framework that aids in a prior-free transparent study of this paradigm. Using our framework, we analyze the role of prior knowledge of the target model data and number of classes in attack performance. We also provide several interesting insights based on our analysis, and demonstrate that priors cause overestimation in transferability scores. Finally, we extend our framework to query-based attacks. This extension inspires a novel image-blending technique to prepare data for effective surrogate model training.
title On Transfer-based Universal Attacks in Pure Black-box Setting
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2504.08866