Hybrid Open-set Segmentation with Synthetic Negative Data

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Grcić, Matej, Šegvić, Siniša
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913326509850624
author Grcić, Matej
Šegvić, Siniša
author_facet Grcić, Matej
Šegvić, Siniša
contents Open-set segmentation can be conceived by complementing closed-set classification with anomaly detection. Many of the existing dense anomaly detectors operate through generative modelling of regular data or by discriminating with respect to negative data. These two approaches optimize different objectives and therefore exhibit different failure modes. Consequently, we propose a novel anomaly score that fuses generative and discriminative cues. Our score can be implemented by upgrading any closed-set segmentation model with dense estimates of dataset posterior and unnormalized data likelihood. The resulting dense hybrid open-set models require negative training images that can be sampled from an auxiliary negative dataset, from a jointly trained generative model, or from a mixture of both sources. We evaluate our contributions on benchmarks for dense anomaly detection and open-set segmentation. The experiments reveal strong open-set performance in spite of negligible computational overhead.
format Preprint
id arxiv_https___arxiv_org_abs_2301_08555
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Hybrid Open-set Segmentation with Synthetic Negative Data
Grcić, Matej
Šegvić, Siniša
Computer Vision and Pattern Recognition
Open-set segmentation can be conceived by complementing closed-set classification with anomaly detection. Many of the existing dense anomaly detectors operate through generative modelling of regular data or by discriminating with respect to negative data. These two approaches optimize different objectives and therefore exhibit different failure modes. Consequently, we propose a novel anomaly score that fuses generative and discriminative cues. Our score can be implemented by upgrading any closed-set segmentation model with dense estimates of dataset posterior and unnormalized data likelihood. The resulting dense hybrid open-set models require negative training images that can be sampled from an auxiliary negative dataset, from a jointly trained generative model, or from a mixture of both sources. We evaluate our contributions on benchmarks for dense anomaly detection and open-set segmentation. The experiments reveal strong open-set performance in spite of negligible computational overhead.
title Hybrid Open-set Segmentation with Synthetic Negative Data
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2301.08555