DefectFill: Realistic Defect Generation with Inpainting Diffusion Model for Visual Inspection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Song, Jaewoo, Park, Daemin, Baek, Kanghyun, Lee, Sangyub, Choi, Jooyoung, Kim, Eunji, Yoon, Sungroh
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915214799142912
author Song, Jaewoo
Park, Daemin
Baek, Kanghyun
Lee, Sangyub
Choi, Jooyoung
Kim, Eunji
Yoon, Sungroh
author_facet Song, Jaewoo
Park, Daemin
Baek, Kanghyun
Lee, Sangyub
Choi, Jooyoung
Kim, Eunji
Yoon, Sungroh
contents Developing effective visual inspection models remains challenging due to the scarcity of defect data. While image generation models have been used to synthesize defect images, producing highly realistic defects remains difficult. We propose DefectFill, a novel method for realistic defect generation that requires only a few reference defect images. It leverages a fine-tuned inpainting diffusion model, optimized with our custom loss functions incorporating defect, object, and attention terms. It enables precise capture of detailed, localized defect features and their seamless integration into defect-free objects. Additionally, our Low-Fidelity Selection method further enhances the defect sample quality. Experiments show that DefectFill generates high-quality defect images, enabling visual inspection models to achieve state-of-the-art performance on the MVTec AD dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2503_13985
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DefectFill: Realistic Defect Generation with Inpainting Diffusion Model for Visual Inspection
Song, Jaewoo
Park, Daemin
Baek, Kanghyun
Lee, Sangyub
Choi, Jooyoung
Kim, Eunji
Yoon, Sungroh
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Developing effective visual inspection models remains challenging due to the scarcity of defect data. While image generation models have been used to synthesize defect images, producing highly realistic defects remains difficult. We propose DefectFill, a novel method for realistic defect generation that requires only a few reference defect images. It leverages a fine-tuned inpainting diffusion model, optimized with our custom loss functions incorporating defect, object, and attention terms. It enables precise capture of detailed, localized defect features and their seamless integration into defect-free objects. Additionally, our Low-Fidelity Selection method further enhances the defect sample quality. Experiments show that DefectFill generates high-quality defect images, enabling visual inspection models to achieve state-of-the-art performance on the MVTec AD dataset.
title DefectFill: Realistic Defect Generation with Inpainting Diffusion Model for Visual Inspection
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2503.13985