Outlier detection by ensembling uncertainty with negative objectness

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Delić, Anja, Grcić, Matej, Šegvić, Siniša
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912018461622272
author Delić, Anja
Grcić, Matej
Šegvić, Siniša
author_facet Delić, Anja
Grcić, Matej
Šegvić, Siniša
contents Outlier detection is an essential capability in safety-critical applications of supervised visual recognition. Most of the existing methods deliver best results by encouraging standard closed-set models to produce low-confidence predictions in negative training data. However, that approach conflates prediction uncertainty with recognition of the negative class. We therefore reconsider direct prediction of K+1 logits that correspond to K groundtruth classes and one outlier class. This setup allows us to formulate a novel anomaly score as an ensemble of in-distribution uncertainty and the posterior of the outlier class which we term negative objectness. Now outliers can be independently detected due to i) high prediction uncertainty or ii) similarity with negative data. We embed our method into a dense prediction architecture with mask-level recognition over K+2 classes. The training procedure encourages the novel K+2-th class to learn negative objectness at pasted negative instances. Our models outperform the current state-of-the art on standard benchmarks for image-wide and pixel-level outlier detection with and without training on real negative data.
format Preprint
id arxiv_https___arxiv_org_abs_2402_15374
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Outlier detection by ensembling uncertainty with negative objectness
Delić, Anja
Grcić, Matej
Šegvić, Siniša
Computer Vision and Pattern Recognition
Machine Learning
Outlier detection is an essential capability in safety-critical applications of supervised visual recognition. Most of the existing methods deliver best results by encouraging standard closed-set models to produce low-confidence predictions in negative training data. However, that approach conflates prediction uncertainty with recognition of the negative class. We therefore reconsider direct prediction of K+1 logits that correspond to K groundtruth classes and one outlier class. This setup allows us to formulate a novel anomaly score as an ensemble of in-distribution uncertainty and the posterior of the outlier class which we term negative objectness. Now outliers can be independently detected due to i) high prediction uncertainty or ii) similarity with negative data. We embed our method into a dense prediction architecture with mask-level recognition over K+2 classes. The training procedure encourages the novel K+2-th class to learn negative objectness at pasted negative instances. Our models outperform the current state-of-the art on standard benchmarks for image-wide and pixel-level outlier detection with and without training on real negative data.
title Outlier detection by ensembling uncertainty with negative objectness
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2402.15374