Bridging Annotation Gaps: Transferring Labels to Align Object Detection Datasets

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kennerley, Mikhail, Aviles-Rivero, Angelica, Schönlieb, Carola-Bibiane, Tan, Robby T.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912417108197376
author Kennerley, Mikhail
Aviles-Rivero, Angelica
Schönlieb, Carola-Bibiane
Tan, Robby T.
author_facet Kennerley, Mikhail
Aviles-Rivero, Angelica
Schönlieb, Carola-Bibiane
Tan, Robby T.
contents Combining multiple object detection datasets offers a path to improved generalisation but is hindered by inconsistencies in class semantics and bounding box annotations. Some methods to address this assume shared label taxonomies and address only spatial inconsistencies; others require manual relabelling, or produce a unified label space, which may be unsuitable when a fixed target label space is required. We propose Label-Aligned Transfer (LAT), a label transfer framework that systematically projects annotations from diverse source datasets into the label space of a target dataset. LAT begins by training dataset-specific detectors to generate pseudo-labels, which are then combined with ground-truth annotations via a Privileged Proposal Generator (PPG) that replaces the region proposal network in two-stage detectors. To further refine region features, a Semantic Feature Fusion (SFF) module injects class-aware context and features from overlapping proposals using a confidence-weighted attention mechanism. This pipeline preserves dataset-specific annotation granularity while enabling many-to-one label space transfer across heterogeneous datasets, resulting in a semantically and spatially aligned representation suitable for training a downstream detector. LAT thus jointly addresses both class-level misalignments and bounding box inconsistencies without relying on shared label spaces or manual annotations. Across multiple benchmarks, LAT demonstrates consistent improvements in target-domain detection performance, achieving gains of up to +4.8AP over semi-supervised baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2506_04737
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Bridging Annotation Gaps: Transferring Labels to Align Object Detection Datasets
Kennerley, Mikhail
Aviles-Rivero, Angelica
Schönlieb, Carola-Bibiane
Tan, Robby T.
Computer Vision and Pattern Recognition
Combining multiple object detection datasets offers a path to improved generalisation but is hindered by inconsistencies in class semantics and bounding box annotations. Some methods to address this assume shared label taxonomies and address only spatial inconsistencies; others require manual relabelling, or produce a unified label space, which may be unsuitable when a fixed target label space is required. We propose Label-Aligned Transfer (LAT), a label transfer framework that systematically projects annotations from diverse source datasets into the label space of a target dataset. LAT begins by training dataset-specific detectors to generate pseudo-labels, which are then combined with ground-truth annotations via a Privileged Proposal Generator (PPG) that replaces the region proposal network in two-stage detectors. To further refine region features, a Semantic Feature Fusion (SFF) module injects class-aware context and features from overlapping proposals using a confidence-weighted attention mechanism. This pipeline preserves dataset-specific annotation granularity while enabling many-to-one label space transfer across heterogeneous datasets, resulting in a semantically and spatially aligned representation suitable for training a downstream detector. LAT thus jointly addresses both class-level misalignments and bounding box inconsistencies without relying on shared label spaces or manual annotations. Across multiple benchmarks, LAT demonstrates consistent improvements in target-domain detection performance, achieving gains of up to +4.8AP over semi-supervised baselines.
title Bridging Annotation Gaps: Transferring Labels to Align Object Detection Datasets
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.04737