Towards Unsupervised Validation of Anomaly-Detection Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Idan, Lihi
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917883102101504
author Idan, Lihi
author_facet Idan, Lihi
contents Unsupervised validation of anomaly-detection models is a highly challenging task. While the common practices for model validation involve a labeled validation set, such validation sets cannot be constructed when the underlying datasets are unlabeled. The lack of robust and efficient unsupervised model-validation techniques presents an acute challenge in the implementation of automated anomaly-detection pipelines, especially when there exists no prior knowledge of the model's performance on similar datasets. This work presents a new paradigm to automated validation of anomaly-detection models, inspired by real-world, collaborative decision-making mechanisms. We focus on two commonly-used, unsupervised model-validation tasks -- model selection and model evaluation -- and provide extensive experimental results that demonstrate the accuracy and robustness of our approach on both tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2410_14579
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Unsupervised Validation of Anomaly-Detection Models
Idan, Lihi
Machine Learning
Artificial Intelligence
Unsupervised validation of anomaly-detection models is a highly challenging task. While the common practices for model validation involve a labeled validation set, such validation sets cannot be constructed when the underlying datasets are unlabeled. The lack of robust and efficient unsupervised model-validation techniques presents an acute challenge in the implementation of automated anomaly-detection pipelines, especially when there exists no prior knowledge of the model's performance on similar datasets. This work presents a new paradigm to automated validation of anomaly-detection models, inspired by real-world, collaborative decision-making mechanisms. We focus on two commonly-used, unsupervised model-validation tasks -- model selection and model evaluation -- and provide extensive experimental results that demonstrate the accuracy and robustness of our approach on both tasks.
title Towards Unsupervised Validation of Anomaly-Detection Models
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2410.14579