Learning Unified Reference Representation for Unsupervised Multi-class Anomaly Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: He, Liren, Jiang, Zhengkai, Peng, Jinlong, Liu, Liang, Du, Qiangang, Hu, Xiaobin, Zhu, Wenbing, Chi, Mingmin, Wang, Yabiao, Wang, Chengjie
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910528139427840
author He, Liren
Jiang, Zhengkai
Peng, Jinlong
Liu, Liang
Du, Qiangang
Hu, Xiaobin
Zhu, Wenbing
Chi, Mingmin
Wang, Yabiao
Wang, Chengjie
author_facet He, Liren
Jiang, Zhengkai
Peng, Jinlong
Liu, Liang
Du, Qiangang
Hu, Xiaobin
Zhu, Wenbing
Chi, Mingmin
Wang, Yabiao
Wang, Chengjie
contents In the field of multi-class anomaly detection, reconstruction-based methods derived from single-class anomaly detection face the well-known challenge of "learning shortcuts", wherein the model fails to learn the patterns of normal samples as it should, opting instead for shortcuts such as identity mapping or artificial noise elimination. Consequently, the model becomes unable to reconstruct genuine anomalies as normal instances, resulting in a failure of anomaly detection. To counter this issue, we present a novel unified feature reconstruction-based anomaly detection framework termed RLR (Reconstruct features from a Learnable Reference representation). Unlike previous methods, RLR utilizes learnable reference representations to compel the model to learn normal feature patterns explicitly, thereby prevents the model from succumbing to the "learning shortcuts" issue. Additionally, RLR incorporates locality constraints into the learnable reference to facilitate more effective normal pattern capture and utilizes a masked learnable key attention mechanism to enhance robustness. Evaluation of RLR on the 15-category MVTec-AD dataset and the 12-category VisA dataset shows superior performance compared to state-of-the-art methods under the unified setting. The code of RLR will be publicly available.
format Preprint
id arxiv_https___arxiv_org_abs_2403_11561
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning Unified Reference Representation for Unsupervised Multi-class Anomaly Detection
He, Liren
Jiang, Zhengkai
Peng, Jinlong
Liu, Liang
Du, Qiangang
Hu, Xiaobin
Zhu, Wenbing
Chi, Mingmin
Wang, Yabiao
Wang, Chengjie
Computer Vision and Pattern Recognition
In the field of multi-class anomaly detection, reconstruction-based methods derived from single-class anomaly detection face the well-known challenge of "learning shortcuts", wherein the model fails to learn the patterns of normal samples as it should, opting instead for shortcuts such as identity mapping or artificial noise elimination. Consequently, the model becomes unable to reconstruct genuine anomalies as normal instances, resulting in a failure of anomaly detection. To counter this issue, we present a novel unified feature reconstruction-based anomaly detection framework termed RLR (Reconstruct features from a Learnable Reference representation). Unlike previous methods, RLR utilizes learnable reference representations to compel the model to learn normal feature patterns explicitly, thereby prevents the model from succumbing to the "learning shortcuts" issue. Additionally, RLR incorporates locality constraints into the learnable reference to facilitate more effective normal pattern capture and utilizes a masked learnable key attention mechanism to enhance robustness. Evaluation of RLR on the 15-category MVTec-AD dataset and the 12-category VisA dataset shows superior performance compared to state-of-the-art methods under the unified setting. The code of RLR will be publicly available.
title Learning Unified Reference Representation for Unsupervised Multi-class Anomaly Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.11561