An Uncertainty-aware DETR Enhancement Framework for Object Detection

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Xingshu, Yu, Sicheng, Cheng, Chong, Wang, Hao, Tian, Ting
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913950102192128
author Chen, Xingshu
Yu, Sicheng
Cheng, Chong
Wang, Hao
Tian, Ting
author_facet Chen, Xingshu
Yu, Sicheng
Cheng, Chong
Wang, Hao
Tian, Ting
contents This paper investigates the problem of object detection with a focus on improving both the localization accuracy of bounding boxes and explicitly modeling prediction uncertainty. Conventional detectors rely on deterministic bounding box regression, ignoring uncertainty in predictions and limiting model robustness. In this paper, we propose an uncertainty-aware enhancement framework for DETR-based object detectors. We model bounding boxes as multivariate Gaussian distributions and incorporate the Gromov-Wasserstein distance into the loss function to better align the predicted and ground-truth distributions. Building on this, we derive a Bayes Risk formulation to filter high-risk information and improve detection reliability. We also propose a simple algorithm to quantify localization uncertainty via confidence intervals. Experiments on the COCO benchmark show that our method can be effectively integrated into existing DETR variants, enhancing their performance. We further extend our framework to leukocyte detection tasks, achieving state-of-the-art results on the LISC and WBCDD datasets. These results confirm the scalability of our framework across both general and domain-specific detection tasks. Code page: https://github.com/ParadiseforAndaChen/An-Uncertainty-aware-DETR-Enhancement-Framework-for-Object-Detection.
format Preprint
id arxiv_https___arxiv_org_abs_2507_14855
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle An Uncertainty-aware DETR Enhancement Framework for Object Detection
Chen, Xingshu
Yu, Sicheng
Cheng, Chong
Wang, Hao
Tian, Ting
Computer Vision and Pattern Recognition
This paper investigates the problem of object detection with a focus on improving both the localization accuracy of bounding boxes and explicitly modeling prediction uncertainty. Conventional detectors rely on deterministic bounding box regression, ignoring uncertainty in predictions and limiting model robustness. In this paper, we propose an uncertainty-aware enhancement framework for DETR-based object detectors. We model bounding boxes as multivariate Gaussian distributions and incorporate the Gromov-Wasserstein distance into the loss function to better align the predicted and ground-truth distributions. Building on this, we derive a Bayes Risk formulation to filter high-risk information and improve detection reliability. We also propose a simple algorithm to quantify localization uncertainty via confidence intervals. Experiments on the COCO benchmark show that our method can be effectively integrated into existing DETR variants, enhancing their performance. We further extend our framework to leukocyte detection tasks, achieving state-of-the-art results on the LISC and WBCDD datasets. These results confirm the scalability of our framework across both general and domain-specific detection tasks. Code page: https://github.com/ParadiseforAndaChen/An-Uncertainty-aware-DETR-Enhancement-Framework-for-Object-Detection.
title An Uncertainty-aware DETR Enhancement Framework for Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.14855