Dense outlier detection and open-set recognition based on training with noisy negative images

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Bevandić, Petra, Krešo, Ivan, Oršić, Marin, Šegvić, Siniša
Format: Preprint
Publié: 2021
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913261239140352
author Bevandić, Petra
Krešo, Ivan
Oršić, Marin
Šegvić, Siniša
author_facet Bevandić, Petra
Krešo, Ivan
Oršić, Marin
Šegvić, Siniša
contents Deep convolutional models often produce inadequate predictions for inputs foreign to the training distribution. Consequently, the problem of detecting outlier images has recently been receiving a lot of attention. Unlike most previous work, we address this problem in the dense prediction context in order to be able to locate outlier objects in front of in-distribution background. Our approach is based on two reasonable assumptions. First, we assume that the inlier dataset is related to some narrow application field (e.g.~road driving). Second, we assume that there exists a general-purpose dataset which is much more diverse than the inlier dataset (e.g.~ImageNet-1k). We consider pixels from the general-purpose dataset as noisy negative training samples since most (but not all) of them are outliers. We encourage the model to recognize borders between known and unknown by pasting jittered negative patches over inlier training images. Our experiments target two dense open-set recognition benchmarks (WildDash 1 and Fishyscapes) and one dense open-set recognition dataset (StreetHazard). Extensive performance evaluation indicates competitive potential of the proposed approach.
format Preprint
id arxiv_https___arxiv_org_abs_2101_09193
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Dense outlier detection and open-set recognition based on training with noisy negative images
Bevandić, Petra
Krešo, Ivan
Oršić, Marin
Šegvić, Siniša
Computer Vision and Pattern Recognition
Deep convolutional models often produce inadequate predictions for inputs foreign to the training distribution. Consequently, the problem of detecting outlier images has recently been receiving a lot of attention. Unlike most previous work, we address this problem in the dense prediction context in order to be able to locate outlier objects in front of in-distribution background. Our approach is based on two reasonable assumptions. First, we assume that the inlier dataset is related to some narrow application field (e.g.~road driving). Second, we assume that there exists a general-purpose dataset which is much more diverse than the inlier dataset (e.g.~ImageNet-1k). We consider pixels from the general-purpose dataset as noisy negative training samples since most (but not all) of them are outliers. We encourage the model to recognize borders between known and unknown by pasting jittered negative patches over inlier training images. Our experiments target two dense open-set recognition benchmarks (WildDash 1 and Fishyscapes) and one dense open-set recognition dataset (StreetHazard). Extensive performance evaluation indicates competitive potential of the proposed approach.
title Dense outlier detection and open-set recognition based on training with noisy negative images
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2101.09193