Adversarial Manhole: Challenging Monocular Depth Estimation and Semantic Segmentation Models with Patch Attack

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Suryanto, Naufal, Adiputra, Andro Aprila, Kadiptya, Ahmada Yusril, Kim, Yongsu, Kim, Howon
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912002802188288
author Suryanto, Naufal
Adiputra, Andro Aprila
Kadiptya, Ahmada Yusril
Kim, Yongsu
Kim, Howon
author_facet Suryanto, Naufal
Adiputra, Andro Aprila
Kadiptya, Ahmada Yusril
Kim, Yongsu
Kim, Howon
contents Monocular depth estimation (MDE) and semantic segmentation (SS) are crucial for the navigation and environmental interpretation of many autonomous driving systems. However, their vulnerability to practical adversarial attacks is a significant concern. This paper presents a novel adversarial attack using practical patches that mimic manhole covers to deceive MDE and SS models. The goal is to cause these systems to misinterpret scenes, leading to false detections of near obstacles or non-passable objects. We use Depth Planar Mapping to precisely position these patches on road surfaces, enhancing the attack's effectiveness. Our experiments show that these adversarial patches cause a 43% relative error in MDE and achieve a 96% attack success rate in SS. These patches create affected error regions over twice their size in MDE and approximately equal to their size in SS. Our studies also confirm the patch's effectiveness in physical simulations, the adaptability of the patches across different target models, and the effectiveness of our proposed modules, highlighting their practical implications.
format Preprint
id arxiv_https___arxiv_org_abs_2408_14879
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Adversarial Manhole: Challenging Monocular Depth Estimation and Semantic Segmentation Models with Patch Attack
Suryanto, Naufal
Adiputra, Andro Aprila
Kadiptya, Ahmada Yusril
Kim, Yongsu
Kim, Howon
Computer Vision and Pattern Recognition
Monocular depth estimation (MDE) and semantic segmentation (SS) are crucial for the navigation and environmental interpretation of many autonomous driving systems. However, their vulnerability to practical adversarial attacks is a significant concern. This paper presents a novel adversarial attack using practical patches that mimic manhole covers to deceive MDE and SS models. The goal is to cause these systems to misinterpret scenes, leading to false detections of near obstacles or non-passable objects. We use Depth Planar Mapping to precisely position these patches on road surfaces, enhancing the attack's effectiveness. Our experiments show that these adversarial patches cause a 43% relative error in MDE and achieve a 96% attack success rate in SS. These patches create affected error regions over twice their size in MDE and approximately equal to their size in SS. Our studies also confirm the patch's effectiveness in physical simulations, the adaptability of the patches across different target models, and the effectiveness of our proposed modules, highlighting their practical implications.
title Adversarial Manhole: Challenging Monocular Depth Estimation and Semantic Segmentation Models with Patch Attack
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.14879