Auto-Labeling Data for Object Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Griffin, Brent A., Gangwar, Manushree, Sela, Jacob, Corso, Jason J.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915320377114624
author Griffin, Brent A.
Gangwar, Manushree
Sela, Jacob
Corso, Jason J.
author_facet Griffin, Brent A.
Gangwar, Manushree
Sela, Jacob
Corso, Jason J.
contents Great labels make great models. However, traditional labeling approaches for tasks like object detection have substantial costs at scale. Furthermore, alternatives to fully-supervised object detection either lose functionality or require larger models with prohibitive computational costs for inference at scale. To that end, this paper addresses the problem of training standard object detection models without any ground truth labels. Instead, we configure previously-trained vision-language foundation models to generate application-specific pseudo "ground truth" labels. These auto-generated labels directly integrate with existing model training frameworks, and we subsequently train lightweight detection models that are computationally efficient. In this way, we avoid the costs of traditional labeling, leverage the knowledge of vision-language models, and keep the efficiency of lightweight models for practical application. We perform exhaustive experiments across multiple labeling configurations, downstream inference models, and datasets to establish best practices and set an extensive auto-labeling benchmark. From our results, we find that our approach is a viable alternative to standard labeling in that it maintains competitive performance on multiple datasets and substantially reduces labeling time and costs.
format Preprint
id arxiv_https___arxiv_org_abs_2506_02359
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Auto-Labeling Data for Object Detection
Griffin, Brent A.
Gangwar, Manushree
Sela, Jacob
Corso, Jason J.
Computer Vision and Pattern Recognition
Great labels make great models. However, traditional labeling approaches for tasks like object detection have substantial costs at scale. Furthermore, alternatives to fully-supervised object detection either lose functionality or require larger models with prohibitive computational costs for inference at scale. To that end, this paper addresses the problem of training standard object detection models without any ground truth labels. Instead, we configure previously-trained vision-language foundation models to generate application-specific pseudo "ground truth" labels. These auto-generated labels directly integrate with existing model training frameworks, and we subsequently train lightweight detection models that are computationally efficient. In this way, we avoid the costs of traditional labeling, leverage the knowledge of vision-language models, and keep the efficiency of lightweight models for practical application. We perform exhaustive experiments across multiple labeling configurations, downstream inference models, and datasets to establish best practices and set an extensive auto-labeling benchmark. From our results, we find that our approach is a viable alternative to standard labeling in that it maintains competitive performance on multiple datasets and substantially reduces labeling time and costs.
title Auto-Labeling Data for Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.02359