Enregistré dans:
Détails bibliographiques
Auteurs principaux: Toller, Maximilian, Hussain, Hussain, Kern, Roman, Geiger, Bernhard C.
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2409.20208
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917790647058432
author Toller, Maximilian
Hussain, Hussain
Kern, Roman
Geiger, Bernhard C.
author_facet Toller, Maximilian
Hussain, Hussain
Kern, Roman
Geiger, Bernhard C.
contents We propose the novel concept of anomaly-free regions (AFR) to improve anomaly detection. An AFR is a region in the data space for which it is known that there are no anomalies inside it, e.g., via domain knowledge. This region can contain any number of normal data points and can be anywhere in the data space. AFRs have the key advantage that they constrain the estimation of the distribution of non-anomalies: The estimated probability mass inside the AFR must be consistent with the number of normal data points inside the AFR. Based on this insight, we provide a solid theoretical foundation and a reference implementation of anomaly detection using AFRs. Our empirical results confirm that anomaly detection constrained via AFRs improves upon unconstrained anomaly detection. Specifically, we show that, when equipped with an estimated AFR, an efficient algorithm based on random guessing becomes a strong baseline that several widely-used methods struggle to overcome. On a dataset with a ground-truth AFR available, the current state of the art is outperformed.
format Preprint
id arxiv_https___arxiv_org_abs_2409_20208
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Constraining Anomaly Detection with Anomaly-Free Regions
Toller, Maximilian
Hussain, Hussain
Kern, Roman
Geiger, Bernhard C.
Machine Learning
We propose the novel concept of anomaly-free regions (AFR) to improve anomaly detection. An AFR is a region in the data space for which it is known that there are no anomalies inside it, e.g., via domain knowledge. This region can contain any number of normal data points and can be anywhere in the data space. AFRs have the key advantage that they constrain the estimation of the distribution of non-anomalies: The estimated probability mass inside the AFR must be consistent with the number of normal data points inside the AFR. Based on this insight, we provide a solid theoretical foundation and a reference implementation of anomaly detection using AFRs. Our empirical results confirm that anomaly detection constrained via AFRs improves upon unconstrained anomaly detection. Specifically, we show that, when equipped with an estimated AFR, an efficient algorithm based on random guessing becomes a strong baseline that several widely-used methods struggle to overcome. On a dataset with a ground-truth AFR available, the current state of the art is outperformed.
title Constraining Anomaly Detection with Anomaly-Free Regions
topic Machine Learning
url https://arxiv.org/abs/2409.20208