SEM-CLIP: Precise Few-Shot Learning for Nanoscale Defect Detection in Scanning Electron Microscope Image

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jin, Qian, Jiang, Yuqi, Lu, Xudong, Liu, Yumeng, Chen, Yining, Gao, Dawei, Sun, Qi, Zhuo, Cheng
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910837866758144
author Jin, Qian
Jiang, Yuqi
Lu, Xudong
Liu, Yumeng
Chen, Yining
Gao, Dawei
Sun, Qi
Zhuo, Cheng
author_facet Jin, Qian
Jiang, Yuqi
Lu, Xudong
Liu, Yumeng
Chen, Yining
Gao, Dawei
Sun, Qi
Zhuo, Cheng
contents In the field of integrated circuit manufacturing, the detection and classification of nanoscale wafer defects are critical for subsequent root cause analysis and yield enhancement. The complex background patterns observed in scanning electron microscope (SEM) images and the diverse textures of the defects pose significant challenges. Traditional methods usually suffer from insufficient data, labels, and poor transferability. In this paper, we propose a novel few-shot learning approach, SEM-CLIP, for accurate defect classification and segmentation. SEM-CLIP customizes the Contrastive Language-Image Pretraining (CLIP) model to better focus on defect areas and minimize background distractions, thereby enhancing segmentation accuracy. We employ text prompts enriched with domain knowledge as prior information to assist in precise analysis. Additionally, our approach incorporates feature engineering with textual guidance to categorize defects more effectively. SEM-CLIP requires little annotated data, substantially reducing labor demands in the semiconductor industry. Extensive experimental validation demonstrates that our model achieves impressive classification and segmentation results under few-shot learning scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2502_14884
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SEM-CLIP: Precise Few-Shot Learning for Nanoscale Defect Detection in Scanning Electron Microscope Image
Jin, Qian
Jiang, Yuqi
Lu, Xudong
Liu, Yumeng
Chen, Yining
Gao, Dawei
Sun, Qi
Zhuo, Cheng
Computer Vision and Pattern Recognition
Machine Learning
In the field of integrated circuit manufacturing, the detection and classification of nanoscale wafer defects are critical for subsequent root cause analysis and yield enhancement. The complex background patterns observed in scanning electron microscope (SEM) images and the diverse textures of the defects pose significant challenges. Traditional methods usually suffer from insufficient data, labels, and poor transferability. In this paper, we propose a novel few-shot learning approach, SEM-CLIP, for accurate defect classification and segmentation. SEM-CLIP customizes the Contrastive Language-Image Pretraining (CLIP) model to better focus on defect areas and minimize background distractions, thereby enhancing segmentation accuracy. We employ text prompts enriched with domain knowledge as prior information to assist in precise analysis. Additionally, our approach incorporates feature engineering with textual guidance to categorize defects more effectively. SEM-CLIP requires little annotated data, substantially reducing labor demands in the semiconductor industry. Extensive experimental validation demonstrates that our model achieves impressive classification and segmentation results under few-shot learning scenarios.
title SEM-CLIP: Precise Few-Shot Learning for Nanoscale Defect Detection in Scanning Electron Microscope Image
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2502.14884