DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Marimont, Sergio Naval, Baugh, Matthew, Siomos, Vasilis, Tzelepis, Christos, Kainz, Bernhard, Tarroni, Giacomo
Format: Preprint
Publié: 2023
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929264373268480
author Marimont, Sergio Naval
Baugh, Matthew
Siomos, Vasilis
Tzelepis, Christos
Kainz, Bernhard
Tarroni, Giacomo
author_facet Marimont, Sergio Naval
Baugh, Matthew
Siomos, Vasilis
Tzelepis, Christos
Kainz, Bernhard
Tarroni, Giacomo
contents Unsupervised Anomaly Detection (UAD) techniques aim to identify and localize anomalies without relying on annotations, only leveraging a model trained on a dataset known to be free of anomalies. Diffusion models learn to modify inputs $x$ to increase the probability of it belonging to a desired distribution, i.e., they model the score function $\nabla_x \log p(x)$. Such a score function is potentially relevant for UAD, since $\nabla_x \log p(x)$ is itself a pixel-wise anomaly score. However, diffusion models are trained to invert a corruption process based on Gaussian noise and the learned score function is unlikely to generalize to medical anomalies. This work addresses the problem of how to learn a score function relevant for UAD and proposes DISYRE: Diffusion-Inspired SYnthetic REstoration. We retain the diffusion-like pipeline but replace the Gaussian noise corruption with a gradual, synthetic anomaly corruption so the learned score function generalizes to medical, naturally occurring anomalies. We evaluate DISYRE on three common Brain MRI UAD benchmarks and substantially outperform other methods in two out of the three tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2311_15453
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection
Marimont, Sergio Naval
Baugh, Matthew
Siomos, Vasilis
Tzelepis, Christos
Kainz, Bernhard
Tarroni, Giacomo
Computer Vision and Pattern Recognition
Image and Video Processing
Unsupervised Anomaly Detection (UAD) techniques aim to identify and localize anomalies without relying on annotations, only leveraging a model trained on a dataset known to be free of anomalies. Diffusion models learn to modify inputs $x$ to increase the probability of it belonging to a desired distribution, i.e., they model the score function $\nabla_x \log p(x)$. Such a score function is potentially relevant for UAD, since $\nabla_x \log p(x)$ is itself a pixel-wise anomaly score. However, diffusion models are trained to invert a corruption process based on Gaussian noise and the learned score function is unlikely to generalize to medical anomalies. This work addresses the problem of how to learn a score function relevant for UAD and proposes DISYRE: Diffusion-Inspired SYnthetic REstoration. We retain the diffusion-like pipeline but replace the Gaussian noise corruption with a gradual, synthetic anomaly corruption so the learned score function generalizes to medical, naturally occurring anomalies. We evaluate DISYRE on three common Brain MRI UAD benchmarks and substantially outperform other methods in two out of the three tasks.
title DISYRE: Diffusion-Inspired SYnthetic REstoration for Unsupervised Anomaly Detection
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2311.15453