Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Yang, Yang, Wang, Wenhai, Chen, Zhe, Dai, Jifeng, Zheng, Liang
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2403.13803
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929283149070336
author Yang, Yang
Wang, Wenhai
Chen, Zhe
Dai, Jifeng
Zheng, Liang
author_facet Yang, Yang
Wang, Wenhai
Chen, Zhe
Dai, Jifeng
Zheng, Liang
contents Bounding boxes uniquely characterize object detection, where a good detector gives accurate bounding boxes of categories of interest. However, in the real-world where test ground truths are not provided, it is non-trivial to find out whether bounding boxes are accurate, thus preventing us from assessing the detector generalization ability. In this work, we find under feature map dropout, good detectors tend to output bounding boxes whose locations do not change much, while bounding boxes of poor detectors will undergo noticeable position changes. We compute the box stability score (BoS score) to reflect this stability. Specifically, given an image, we compute a normal set of bounding boxes and a second set after feature map dropout. To obtain BoS score, we use bipartite matching to find the corresponding boxes between the two sets and compute the average Intersection over Union (IoU) across the entire test set. We contribute to finding that BoS score has a strong, positive correlation with detection accuracy measured by mean average precision (mAP) under various test environments. This relationship allows us to predict the accuracy of detectors on various real-world test sets without accessing test ground truths, verified on canonical detection tasks such as vehicle detection and pedestrian detection. Code and data are available at https://github.com/YangYangGirl/BoS.
format Preprint
id arxiv_https___arxiv_org_abs_2403_13803
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Bounding Box Stability against Feature Dropout Reflects Detector Generalization across Environments
Yang, Yang
Wang, Wenhai
Chen, Zhe
Dai, Jifeng
Zheng, Liang
Computer Vision and Pattern Recognition
Bounding boxes uniquely characterize object detection, where a good detector gives accurate bounding boxes of categories of interest. However, in the real-world where test ground truths are not provided, it is non-trivial to find out whether bounding boxes are accurate, thus preventing us from assessing the detector generalization ability. In this work, we find under feature map dropout, good detectors tend to output bounding boxes whose locations do not change much, while bounding boxes of poor detectors will undergo noticeable position changes. We compute the box stability score (BoS score) to reflect this stability. Specifically, given an image, we compute a normal set of bounding boxes and a second set after feature map dropout. To obtain BoS score, we use bipartite matching to find the corresponding boxes between the two sets and compute the average Intersection over Union (IoU) across the entire test set. We contribute to finding that BoS score has a strong, positive correlation with detection accuracy measured by mean average precision (mAP) under various test environments. This relationship allows us to predict the accuracy of detectors on various real-world test sets without accessing test ground truths, verified on canonical detection tasks such as vehicle detection and pedestrian detection. Code and data are available at https://github.com/YangYangGirl/BoS.
title Bounding Box Stability against Feature Dropout Reflects Detector Generalization across Environments
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.13803