NumbOD: A Spatial-Frequency Fusion Attack Against Object Detectors

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Ziqi, Li, Bowen, Song, Yufei, Yu, Zhifei, Hu, Shengshan, Wan, Wei, Zhang, Leo Yu, Yao, Dezhong, Jin, Hai
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929644533448704
author Zhou, Ziqi
Li, Bowen
Song, Yufei
Yu, Zhifei
Hu, Shengshan
Wan, Wei
Zhang, Leo Yu
Yao, Dezhong
Jin, Hai
author_facet Zhou, Ziqi
Li, Bowen
Song, Yufei
Yu, Zhifei
Hu, Shengshan
Wan, Wei
Zhang, Leo Yu
Yao, Dezhong
Jin, Hai
contents With the advancement of deep learning, object detectors (ODs) with various architectures have achieved significant success in complex scenarios like autonomous driving. Previous adversarial attacks against ODs have been focused on designing customized attacks targeting their specific structures (e.g., NMS and RPN), yielding some results but simultaneously constraining their scalability. Moreover, most efforts against ODs stem from image-level attacks originally designed for classification tasks, resulting in redundant computations and disturbances in object-irrelevant areas (e.g., background). Consequently, how to design a model-agnostic efficient attack to comprehensively evaluate the vulnerabilities of ODs remains challenging and unresolved. In this paper, we propose NumbOD, a brand-new spatial-frequency fusion attack against various ODs, aimed at disrupting object detection within images. We directly leverage the features output by the OD without relying on its internal structures to craft adversarial examples. Specifically, we first design a dual-track attack target selection strategy to select high-quality bounding boxes from OD outputs for targeting. Subsequently, we employ directional perturbations to shift and compress predicted boxes and change classification results to deceive ODs. Additionally, we focus on manipulating the high-frequency components of images to confuse ODs' attention on critical objects, thereby enhancing the attack efficiency. Our extensive experiments on nine ODs and two datasets show that NumbOD achieves powerful attack performance and high stealthiness.
format Preprint
id arxiv_https___arxiv_org_abs_2412_16955
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle NumbOD: A Spatial-Frequency Fusion Attack Against Object Detectors
Zhou, Ziqi
Li, Bowen
Song, Yufei
Yu, Zhifei
Hu, Shengshan
Wan, Wei
Zhang, Leo Yu
Yao, Dezhong
Jin, Hai
Computer Vision and Pattern Recognition
With the advancement of deep learning, object detectors (ODs) with various architectures have achieved significant success in complex scenarios like autonomous driving. Previous adversarial attacks against ODs have been focused on designing customized attacks targeting their specific structures (e.g., NMS and RPN), yielding some results but simultaneously constraining their scalability. Moreover, most efforts against ODs stem from image-level attacks originally designed for classification tasks, resulting in redundant computations and disturbances in object-irrelevant areas (e.g., background). Consequently, how to design a model-agnostic efficient attack to comprehensively evaluate the vulnerabilities of ODs remains challenging and unresolved. In this paper, we propose NumbOD, a brand-new spatial-frequency fusion attack against various ODs, aimed at disrupting object detection within images. We directly leverage the features output by the OD without relying on its internal structures to craft adversarial examples. Specifically, we first design a dual-track attack target selection strategy to select high-quality bounding boxes from OD outputs for targeting. Subsequently, we employ directional perturbations to shift and compress predicted boxes and change classification results to deceive ODs. Additionally, we focus on manipulating the high-frequency components of images to confuse ODs' attention on critical objects, thereby enhancing the attack efficiency. Our extensive experiments on nine ODs and two datasets show that NumbOD achieves powerful attack performance and high stealthiness.
title NumbOD: A Spatial-Frequency Fusion Attack Against Object Detectors
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.16955