Invisible Reflections: Leveraging Infrared Laser Reflections to Target Traffic Sign Perception

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sato, Takami, Bhupathiraju, Sri Hrushikesh Varma, Clifford, Michael, Sugawara, Takeshi, Chen, Qi Alfred, Rampazzi, Sara
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909064574795776
author Sato, Takami
Bhupathiraju, Sri Hrushikesh Varma
Clifford, Michael
Sugawara, Takeshi
Chen, Qi Alfred
Rampazzi, Sara
author_facet Sato, Takami
Bhupathiraju, Sri Hrushikesh Varma
Clifford, Michael
Sugawara, Takeshi
Chen, Qi Alfred
Rampazzi, Sara
contents All vehicles must follow the rules that govern traffic behavior, regardless of whether the vehicles are human-driven or Connected Autonomous Vehicles (CAVs). Road signs indicate locally active rules, such as speed limits and requirements to yield or stop. Recent research has demonstrated attacks, such as adding stickers or projected colored patches to signs, that cause CAV misinterpretation, resulting in potential safety issues. Humans can see and potentially defend against these attacks. But humans can not detect what they can not observe. We have developed an effective physical-world attack that leverages the sensitivity of filterless image sensors and the properties of Infrared Laser Reflections (ILRs), which are invisible to humans. The attack is designed to affect CAV cameras and perception, undermining traffic sign recognition by inducing misclassification. In this work, we formulate the threat model and requirements for an ILR-based traffic sign perception attack to succeed. We evaluate the effectiveness of the ILR attack with real-world experiments against two major traffic sign recognition architectures on four IR-sensitive cameras. Our black-box optimization methodology allows the attack to achieve up to a 100% attack success rate in indoor, static scenarios and a >80.5% attack success rate in our outdoor, moving vehicle scenarios. We find the latest state-of-the-art certifiable defense is ineffective against ILR attacks as it mis-certifies >33.5% of cases. To address this, we propose a detection strategy based on the physical properties of IR laser reflections which can detect 96% of ILR attacks.
format Preprint
id arxiv_https___arxiv_org_abs_2401_03582
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Invisible Reflections: Leveraging Infrared Laser Reflections to Target Traffic Sign Perception
Sato, Takami
Bhupathiraju, Sri Hrushikesh Varma
Clifford, Michael
Sugawara, Takeshi
Chen, Qi Alfred
Rampazzi, Sara
Cryptography and Security
Computer Vision and Pattern Recognition
All vehicles must follow the rules that govern traffic behavior, regardless of whether the vehicles are human-driven or Connected Autonomous Vehicles (CAVs). Road signs indicate locally active rules, such as speed limits and requirements to yield or stop. Recent research has demonstrated attacks, such as adding stickers or projected colored patches to signs, that cause CAV misinterpretation, resulting in potential safety issues. Humans can see and potentially defend against these attacks. But humans can not detect what they can not observe. We have developed an effective physical-world attack that leverages the sensitivity of filterless image sensors and the properties of Infrared Laser Reflections (ILRs), which are invisible to humans. The attack is designed to affect CAV cameras and perception, undermining traffic sign recognition by inducing misclassification. In this work, we formulate the threat model and requirements for an ILR-based traffic sign perception attack to succeed. We evaluate the effectiveness of the ILR attack with real-world experiments against two major traffic sign recognition architectures on four IR-sensitive cameras. Our black-box optimization methodology allows the attack to achieve up to a 100% attack success rate in indoor, static scenarios and a >80.5% attack success rate in our outdoor, moving vehicle scenarios. We find the latest state-of-the-art certifiable defense is ineffective against ILR attacks as it mis-certifies >33.5% of cases. To address this, we propose a detection strategy based on the physical properties of IR laser reflections which can detect 96% of ILR attacks.
title Invisible Reflections: Leveraging Infrared Laser Reflections to Target Traffic Sign Perception
topic Cryptography and Security
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2401.03582