Rectify the Regression Bias in Long-Tailed Object Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhu, Ke, Fu, Minghao, Shao, Jie, Liu, Tianyu, Wu, Jianxin
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914660623581184
author Zhu, Ke
Fu, Minghao
Shao, Jie
Liu, Tianyu
Wu, Jianxin
author_facet Zhu, Ke
Fu, Minghao
Shao, Jie
Liu, Tianyu
Wu, Jianxin
contents Long-tailed object detection faces great challenges because of its extremely imbalanced class distribution. Recent methods mainly focus on the classification bias and its loss function design, while ignoring the subtle influence of the regression branch. This paper shows that the regression bias exists and does adversely and seriously impact the detection accuracy. While existing methods fail to handle the regression bias, the class-specific regression head for rare classes is hypothesized to be the main cause of it in this paper. As a result, three kinds of viable solutions to cater for the rare categories are proposed, including adding a class-agnostic branch, clustering heads and merging heads. The proposed methods brings in consistent and significant improvements over existing long-tailed detection methods, especially in rare and common classes. The proposed method achieves state-of-the-art performance in the large vocabulary LVIS dataset with different backbones and architectures. It generalizes well to more difficult evaluation metrics, relatively balanced datasets, and the mask branch. This is the first attempt to reveal and explore rectifying of the regression bias in long-tailed object detection.
format Preprint
id arxiv_https___arxiv_org_abs_2401_15885
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Rectify the Regression Bias in Long-Tailed Object Detection
Zhu, Ke
Fu, Minghao
Shao, Jie
Liu, Tianyu
Wu, Jianxin
Computer Vision and Pattern Recognition
Long-tailed object detection faces great challenges because of its extremely imbalanced class distribution. Recent methods mainly focus on the classification bias and its loss function design, while ignoring the subtle influence of the regression branch. This paper shows that the regression bias exists and does adversely and seriously impact the detection accuracy. While existing methods fail to handle the regression bias, the class-specific regression head for rare classes is hypothesized to be the main cause of it in this paper. As a result, three kinds of viable solutions to cater for the rare categories are proposed, including adding a class-agnostic branch, clustering heads and merging heads. The proposed methods brings in consistent and significant improvements over existing long-tailed detection methods, especially in rare and common classes. The proposed method achieves state-of-the-art performance in the large vocabulary LVIS dataset with different backbones and architectures. It generalizes well to more difficult evaluation metrics, relatively balanced datasets, and the mask branch. This is the first attempt to reveal and explore rectifying of the regression bias in long-tailed object detection.
title Rectify the Regression Bias in Long-Tailed Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2401.15885