Saved in:
Bibliographic Details
Main Authors: Zhang, Hangtao, Wang, Yichen, Yan, Shihui, Zhu, Chenyu, Zhou, Ziqi, Hou, Linshan, Hu, Shengshan, Li, Minghui, Zhang, Yanjun, Zhang, Leo Yu
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2503.15293
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917961845964800
author Zhang, Hangtao
Wang, Yichen
Yan, Shihui
Zhu, Chenyu
Zhou, Ziqi
Hou, Linshan
Hu, Shengshan
Li, Minghui
Zhang, Yanjun
Zhang, Leo Yu
author_facet Zhang, Hangtao
Wang, Yichen
Yan, Shihui
Zhu, Chenyu
Zhou, Ziqi
Hou, Linshan
Hu, Shengshan
Li, Minghui
Zhang, Yanjun
Zhang, Leo Yu
contents Object detection models are vulnerable to backdoor attacks, where attackers poison a small subset of training samples by embedding a predefined trigger to manipulate prediction. Detecting poisoned samples (i.e., those containing triggers) at test time can prevent backdoor activation. However, unlike image classification tasks, the unique characteristics of object detection -- particularly its output of numerous objects -- pose fresh challenges for backdoor detection. The complex attack effects (e.g., "ghost" object emergence or "vanishing" object) further render current defenses fundamentally inadequate. To this end, we design TRAnsformation Consistency Evaluation (TRACE), a brand-new method for detecting poisoned samples at test time in object detection. Our journey begins with two intriguing observations: (1) poisoned samples exhibit significantly more consistent detection results than clean ones across varied backgrounds. (2) clean samples show higher detection consistency when introduced to different focal information. Based on these phenomena, TRACE applies foreground and background transformations to each test sample, then assesses transformation consistency by calculating the variance in objects confidences. TRACE achieves black-box, universal backdoor detection, with extensive experiments showing a 30% improvement in AUROC over state-of-the-art defenses and resistance to adaptive attacks.
format Preprint
id arxiv_https___arxiv_org_abs_2503_15293
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Test-Time Backdoor Detection for Object Detection Models
Zhang, Hangtao
Wang, Yichen
Yan, Shihui
Zhu, Chenyu
Zhou, Ziqi
Hou, Linshan
Hu, Shengshan
Li, Minghui
Zhang, Yanjun
Zhang, Leo Yu
Computer Vision and Pattern Recognition
Object detection models are vulnerable to backdoor attacks, where attackers poison a small subset of training samples by embedding a predefined trigger to manipulate prediction. Detecting poisoned samples (i.e., those containing triggers) at test time can prevent backdoor activation. However, unlike image classification tasks, the unique characteristics of object detection -- particularly its output of numerous objects -- pose fresh challenges for backdoor detection. The complex attack effects (e.g., "ghost" object emergence or "vanishing" object) further render current defenses fundamentally inadequate. To this end, we design TRAnsformation Consistency Evaluation (TRACE), a brand-new method for detecting poisoned samples at test time in object detection. Our journey begins with two intriguing observations: (1) poisoned samples exhibit significantly more consistent detection results than clean ones across varied backgrounds. (2) clean samples show higher detection consistency when introduced to different focal information. Based on these phenomena, TRACE applies foreground and background transformations to each test sample, then assesses transformation consistency by calculating the variance in objects confidences. TRACE achieves black-box, universal backdoor detection, with extensive experiments showing a 30% improvement in AUROC over state-of-the-art defenses and resistance to adaptive attacks.
title Test-Time Backdoor Detection for Object Detection Models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2503.15293