FSPGD: Rethinking Black-box Attacks on Semantic Segmentation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Park, Eun-Sol, Park, MiSo, Park, Seung, Shin, Yong-Goo
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912261895880704
author Park, Eun-Sol
Park, MiSo
Park, Seung
Shin, Yong-Goo
author_facet Park, Eun-Sol
Park, MiSo
Park, Seung
Shin, Yong-Goo
contents Transferability, the ability of adversarial examples crafted for one model to deceive other models, is crucial for black-box attacks. Despite advancements in attack methods for semantic segmentation, transferability remains limited, reducing their effectiveness in real-world applications. To address this, we introduce the Feature Similarity Projected Gradient Descent (FSPGD) attack, a novel black-box approach that enhances both attack performance and transferability. Unlike conventional segmentation attacks that rely on output predictions for gradient calculation, FSPGD computes gradients from intermediate layer features. Specifically, our method introduces a loss function that targets local information by comparing features between clean images and adversarial examples, while also disrupting contextual information by accounting for spatial relationships between objects. Experiments on Pascal VOC 2012 and Cityscapes datasets demonstrate that FSPGD achieves superior transferability and attack performance, establishing a new state-of-the-art benchmark. Code is available at https://github.com/KU-AIVS/FSPGD.
format Preprint
id arxiv_https___arxiv_org_abs_2502_01262
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FSPGD: Rethinking Black-box Attacks on Semantic Segmentation
Park, Eun-Sol
Park, MiSo
Park, Seung
Shin, Yong-Goo
Computer Vision and Pattern Recognition
Transferability, the ability of adversarial examples crafted for one model to deceive other models, is crucial for black-box attacks. Despite advancements in attack methods for semantic segmentation, transferability remains limited, reducing their effectiveness in real-world applications. To address this, we introduce the Feature Similarity Projected Gradient Descent (FSPGD) attack, a novel black-box approach that enhances both attack performance and transferability. Unlike conventional segmentation attacks that rely on output predictions for gradient calculation, FSPGD computes gradients from intermediate layer features. Specifically, our method introduces a loss function that targets local information by comparing features between clean images and adversarial examples, while also disrupting contextual information by accounting for spatial relationships between objects. Experiments on Pascal VOC 2012 and Cityscapes datasets demonstrate that FSPGD achieves superior transferability and attack performance, establishing a new state-of-the-art benchmark. Code is available at https://github.com/KU-AIVS/FSPGD.
title FSPGD: Rethinking Black-box Attacks on Semantic Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.01262