On Feasibility of Intent Obfuscating Attacks

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Li, Zhaobin, Shafto, Patrick
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914928707764224
author Li, Zhaobin
Shafto, Patrick
author_facet Li, Zhaobin
Shafto, Patrick
contents Intent obfuscation is a common tactic in adversarial situations, enabling the attacker to both manipulate the target system and avoid culpability. Surprisingly, it has rarely been implemented in adversarial attacks on machine learning systems. We are the first to propose using intent obfuscation to generate adversarial examples for object detectors: by perturbing another non-overlapping object to disrupt the target object, the attacker hides their intended target. We conduct a randomized experiment on 5 prominent detectors -- YOLOv3, SSD, RetinaNet, Faster R-CNN, and Cascade R-CNN -- using both targeted and untargeted attacks and achieve success on all models and attacks. We analyze the success factors characterizing intent obfuscating attacks, including target object confidence and perturb object sizes. We then demonstrate that the attacker can exploit these success factors to increase success rates for all models and attacks. Finally, we discuss main takeaways and legal repercussions.
format Preprint
id arxiv_https___arxiv_org_abs_2408_02674
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On Feasibility of Intent Obfuscating Attacks
Li, Zhaobin
Shafto, Patrick
Cryptography and Security
Computer Vision and Pattern Recognition
Intent obfuscation is a common tactic in adversarial situations, enabling the attacker to both manipulate the target system and avoid culpability. Surprisingly, it has rarely been implemented in adversarial attacks on machine learning systems. We are the first to propose using intent obfuscation to generate adversarial examples for object detectors: by perturbing another non-overlapping object to disrupt the target object, the attacker hides their intended target. We conduct a randomized experiment on 5 prominent detectors -- YOLOv3, SSD, RetinaNet, Faster R-CNN, and Cascade R-CNN -- using both targeted and untargeted attacks and achieve success on all models and attacks. We analyze the success factors characterizing intent obfuscating attacks, including target object confidence and perturb object sizes. We then demonstrate that the attacker can exploit these success factors to increase success rates for all models and attacks. Finally, we discuss main takeaways and legal repercussions.
title On Feasibility of Intent Obfuscating Attacks
topic Cryptography and Security
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.02674