Open-Set Object Detection By Aligning Known Class Representations
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912172350636032 |
|---|---|
| author | Sarkar, Hiran Chudasama, Vishal Onoe, Naoyuki Wasnik, Pankaj Balasubramanian, Vineeth N |
| author_facet | Sarkar, Hiran Chudasama, Vishal Onoe, Naoyuki Wasnik, Pankaj Balasubramanian, Vineeth N |
| contents | Open-Set Object Detection (OSOD) has emerged as a contemporary research direction to address the detection of unknown objects. Recently, few works have achieved remarkable performance in the OSOD task by employing contrastive clustering to separate unknown classes. In contrast, we propose a new semantic clustering-based approach to facilitate a meaningful alignment of clusters in semantic space and introduce a class decorrelation module to enhance inter-cluster separation. Our approach further incorporates an object focus module to predict objectness scores, which enhances the detection of unknown objects. Further, we employ i) an evaluation technique that penalizes low-confidence outputs to mitigate the risk of misclassification of the unknown objects and ii) a new metric called HMP that combines known and unknown precision using harmonic mean. Our extensive experiments demonstrate that the proposed model achieves significant improvement on the MS-COCO & PASCAL VOC dataset for the OSOD task. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_20701 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Open-Set Object Detection By Aligning Known Class Representations Sarkar, Hiran Chudasama, Vishal Onoe, Naoyuki Wasnik, Pankaj Balasubramanian, Vineeth N Computer Vision and Pattern Recognition Open-Set Object Detection (OSOD) has emerged as a contemporary research direction to address the detection of unknown objects. Recently, few works have achieved remarkable performance in the OSOD task by employing contrastive clustering to separate unknown classes. In contrast, we propose a new semantic clustering-based approach to facilitate a meaningful alignment of clusters in semantic space and introduce a class decorrelation module to enhance inter-cluster separation. Our approach further incorporates an object focus module to predict objectness scores, which enhances the detection of unknown objects. Further, we employ i) an evaluation technique that penalizes low-confidence outputs to mitigate the risk of misclassification of the unknown objects and ii) a new metric called HMP that combines known and unknown precision using harmonic mean. Our extensive experiments demonstrate that the proposed model achieves significant improvement on the MS-COCO & PASCAL VOC dataset for the OSOD task. |
| title | Open-Set Object Detection By Aligning Known Class Representations |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.20701 |