Rethinking Open-Set Object Detection: Issues, a New Formulation, and Taxonomy

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hosoya, Yusuke, Suganuma, Masanori, Okatani, Takayuki
Formato: Preprint
Publicado: 2022
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915688816312320
author Hosoya, Yusuke
Suganuma, Masanori
Okatani, Takayuki
author_facet Hosoya, Yusuke
Suganuma, Masanori
Okatani, Takayuki
contents Open-set object detection (OSOD), a task involving the detection of unknown objects while accurately detecting known objects, has recently gained attention. However, we identify a fundamental issue with the problem formulation employed in current OSOD studies. Inherent to object detection is knowing "what to detect," which contradicts the idea of identifying "unknown" objects. This sets OSOD apart from open-set recognition (OSR). This contradiction complicates a proper evaluation of methods' performance, a fact that previous studies have overlooked. Next, we propose a novel formulation wherein detectors are required to detect both known and unknown classes within specified super-classes of object classes. This new formulation is free from the aforementioned issues and has practical applications. Finally, we design benchmark tests utilizing existing datasets and report the experimental evaluation of existing OSOD methods. The results show that existing methods fail to accurately detect unknown objects due to misclassification of known and unknown classes rather than incorrect bounding box prediction. As a byproduct, we introduce a taxonomy of OSOD, resolving confusion prevalent in the literature. We anticipate that our study will encourage the research community to reconsider OSOD and facilitate progress in the right direction.
format Preprint
id arxiv_https___arxiv_org_abs_2207_09775
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Rethinking Open-Set Object Detection: Issues, a New Formulation, and Taxonomy
Hosoya, Yusuke
Suganuma, Masanori
Okatani, Takayuki
Computer Vision and Pattern Recognition
Open-set object detection (OSOD), a task involving the detection of unknown objects while accurately detecting known objects, has recently gained attention. However, we identify a fundamental issue with the problem formulation employed in current OSOD studies. Inherent to object detection is knowing "what to detect," which contradicts the idea of identifying "unknown" objects. This sets OSOD apart from open-set recognition (OSR). This contradiction complicates a proper evaluation of methods' performance, a fact that previous studies have overlooked. Next, we propose a novel formulation wherein detectors are required to detect both known and unknown classes within specified super-classes of object classes. This new formulation is free from the aforementioned issues and has practical applications. Finally, we design benchmark tests utilizing existing datasets and report the experimental evaluation of existing OSOD methods. The results show that existing methods fail to accurately detect unknown objects due to misclassification of known and unknown classes rather than incorrect bounding box prediction. As a byproduct, we introduce a taxonomy of OSOD, resolving confusion prevalent in the literature. We anticipate that our study will encourage the research community to reconsider OSOD and facilitate progress in the right direction.
title Rethinking Open-Set Object Detection: Issues, a New Formulation, and Taxonomy
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2207.09775