ConSeg: Contextual Backdoor Attack Against Semantic Segmentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Abbasi, Bilal Hussain, Gong, Zirui, Zhang, Yanjun, Gao, Shang, Robles-Kelly, Antonio, Zhang, Leo
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916865058537472
author Abbasi, Bilal Hussain
Gong, Zirui
Zhang, Yanjun
Gao, Shang
Robles-Kelly, Antonio
Zhang, Leo
author_facet Abbasi, Bilal Hussain
Gong, Zirui
Zhang, Yanjun
Gao, Shang
Robles-Kelly, Antonio
Zhang, Leo
contents Despite significant advancements in computer vision, semantic segmentation models may be susceptible to backdoor attacks. These attacks, involving hidden triggers, aim to cause the models to misclassify instances of the victim class as the target class when triggers are present, posing serious threats to the reliability of these models. To further explore the field of backdoor attacks against semantic segmentation, in this paper, we propose a simple yet effective backdoor attack called Contextual Segmentation Backdoor Attack (ConSeg). ConSeg leverages the contextual information inherent in semantic segmentation models to enhance backdoor performance. Our method is motivated by an intriguing observation, i.e., when the target class is set as the `co-occurring' class of the victim class, the victim class can be more easily `mis-segmented'. Building upon this insight, ConSeg mimics the contextual information of the target class and rebuilds it in the victim region to establish the contextual relationship between the target class and the victim class, making the attack easier. Our experiments reveal that ConSeg achieves improvements in Attack Success Rate (ASR) with increases of 15.55\%, compared to existing methods, while exhibiting resilience against state-of-the-art backdoor defenses.
format Preprint
id arxiv_https___arxiv_org_abs_2507_19905
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ConSeg: Contextual Backdoor Attack Against Semantic Segmentation
Abbasi, Bilal Hussain
Gong, Zirui
Zhang, Yanjun
Gao, Shang
Robles-Kelly, Antonio
Zhang, Leo
Cryptography and Security
Computer Vision and Pattern Recognition
Despite significant advancements in computer vision, semantic segmentation models may be susceptible to backdoor attacks. These attacks, involving hidden triggers, aim to cause the models to misclassify instances of the victim class as the target class when triggers are present, posing serious threats to the reliability of these models. To further explore the field of backdoor attacks against semantic segmentation, in this paper, we propose a simple yet effective backdoor attack called Contextual Segmentation Backdoor Attack (ConSeg). ConSeg leverages the contextual information inherent in semantic segmentation models to enhance backdoor performance. Our method is motivated by an intriguing observation, i.e., when the target class is set as the `co-occurring' class of the victim class, the victim class can be more easily `mis-segmented'. Building upon this insight, ConSeg mimics the contextual information of the target class and rebuilds it in the victim region to establish the contextual relationship between the target class and the victim class, making the attack easier. Our experiments reveal that ConSeg achieves improvements in Attack Success Rate (ASR) with increases of 15.55\%, compared to existing methods, while exhibiting resilience against state-of-the-art backdoor defenses.
title ConSeg: Contextual Backdoor Attack Against Semantic Segmentation
topic Cryptography and Security
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.19905