Saved in:
Bibliographic Details
Main Authors: Longa, Marian, Henriques, João F.
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2406.07284
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913561230442496
author Longa, Marian
Henriques, João F.
author_facet Longa, Marian
Henriques, João F.
contents Unsupervised object detection using deep neural networks is typically a difficult problem with few to no guarantees about the learned representation. In this work we present the first unsupervised object detection method that is theoretically guaranteed to recover the true object positions up to quantifiable small shifts. We develop an unsupervised object detection architecture and prove that the learned variables correspond to the true object positions up to small shifts related to the encoder and decoder receptive field sizes, the object sizes, and the widths of the Gaussians used in the rendering process. We perform detailed analysis of how the error depends on each of these variables and perform synthetic experiments validating our theoretical predictions up to a precision of individual pixels. We also perform experiments on CLEVR-based data and show that, unlike current SOTA object detection methods (SAM, CutLER), our method's prediction errors always lie within our theoretical bounds. We hope that this work helps open up an avenue of research into object detection methods with theoretical guarantees.
format Preprint
id arxiv_https___arxiv_org_abs_2406_07284
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Unsupervised Object Detection with Theoretical Guarantees
Longa, Marian
Henriques, João F.
Computer Vision and Pattern Recognition
Artificial Intelligence
Unsupervised object detection using deep neural networks is typically a difficult problem with few to no guarantees about the learned representation. In this work we present the first unsupervised object detection method that is theoretically guaranteed to recover the true object positions up to quantifiable small shifts. We develop an unsupervised object detection architecture and prove that the learned variables correspond to the true object positions up to small shifts related to the encoder and decoder receptive field sizes, the object sizes, and the widths of the Gaussians used in the rendering process. We perform detailed analysis of how the error depends on each of these variables and perform synthetic experiments validating our theoretical predictions up to a precision of individual pixels. We also perform experiments on CLEVR-based data and show that, unlike current SOTA object detection methods (SAM, CutLER), our method's prediction errors always lie within our theoretical bounds. We hope that this work helps open up an avenue of research into object detection methods with theoretical guarantees.
title Unsupervised Object Detection with Theoretical Guarantees
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2406.07284