ASBench: Image Anomalies Synthesis Benchmark for Anomaly Detection

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Qunyi, Zhang, Songan, Liu, Jiaqi, Wang, Jinbao, Lei, Xiaoning, Xie, Guoyang, Jiang, Guannan, Lu, Zhichao
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911583328796672
author Zhang, Qunyi
Zhang, Songan
Liu, Jiaqi
Wang, Jinbao
Lei, Xiaoning
Xie, Guoyang
Jiang, Guannan
Lu, Zhichao
author_facet Zhang, Qunyi
Zhang, Songan
Liu, Jiaqi
Wang, Jinbao
Lei, Xiaoning
Xie, Guoyang
Jiang, Guannan
Lu, Zhichao
contents Anomaly detection plays a pivotal role in manufacturing quality control, yet its application is constrained by limited abnormal samples and high manual annotation costs. While anomaly synthesis offers a promising solution, existing studies predominantly treat anomaly synthesis as an auxiliary component within anomaly detection frameworks, lacking systematic evaluation of anomaly synthesis algorithms. Current research also overlook crucial factors specific to anomaly synthesis, such as decoupling its impact from detection, quantitative analysis of synthetic data and adaptability across different scenarios. To address these limitations, we propose ASBench, the first comprehensive benchmarking framework dedicated to evaluating anomaly synthesis methods. Our framework introduces four critical evaluation dimensions: (i) the generalization performance across different datasets and pipelines (ii) the ratio of synthetic to real data (iii) the correlation between intrinsic metrics of synthesis images and anomaly detection performance metrics , and (iv) strategies for hybrid anomaly synthesis methods. Through extensive experiments, ASBench not only reveals limitations in current anomaly synthesis methods but also provides actionable insights for future research directions in anomaly synthesis
format Preprint
id arxiv_https___arxiv_org_abs_2510_07927
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ASBench: Image Anomalies Synthesis Benchmark for Anomaly Detection
Zhang, Qunyi
Zhang, Songan
Liu, Jiaqi
Wang, Jinbao
Lei, Xiaoning
Xie, Guoyang
Jiang, Guannan
Lu, Zhichao
Computer Vision and Pattern Recognition
Anomaly detection plays a pivotal role in manufacturing quality control, yet its application is constrained by limited abnormal samples and high manual annotation costs. While anomaly synthesis offers a promising solution, existing studies predominantly treat anomaly synthesis as an auxiliary component within anomaly detection frameworks, lacking systematic evaluation of anomaly synthesis algorithms. Current research also overlook crucial factors specific to anomaly synthesis, such as decoupling its impact from detection, quantitative analysis of synthetic data and adaptability across different scenarios. To address these limitations, we propose ASBench, the first comprehensive benchmarking framework dedicated to evaluating anomaly synthesis methods. Our framework introduces four critical evaluation dimensions: (i) the generalization performance across different datasets and pipelines (ii) the ratio of synthetic to real data (iii) the correlation between intrinsic metrics of synthesis images and anomaly detection performance metrics , and (iv) strategies for hybrid anomaly synthesis methods. Through extensive experiments, ASBench not only reveals limitations in current anomaly synthesis methods but also provides actionable insights for future research directions in anomaly synthesis
title ASBench: Image Anomalies Synthesis Benchmark for Anomaly Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.07927