MaskTerial: A Foundation Model for Automated 2D Material Flake Detection
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912879891972096 |
|---|---|
| author | Uslu, Jan-Lucas Nekrasov, Alexey Hermans, Alexander Beschoten, Bernd Leibe, Bastian Waldecker, Lutz Stampfer, Christoph |
| author_facet | Uslu, Jan-Lucas Nekrasov, Alexey Hermans, Alexander Beschoten, Bernd Leibe, Bastian Waldecker, Lutz Stampfer, Christoph |
| contents | The detection and classification of exfoliated two-dimensional (2D) material flakes from optical microscope images can be automated using computer vision algorithms. This has the potential to increase the accuracy and objectivity of classification and the efficiency of sample fabrication, and it allows for large-scale data collection. Existing algorithms often exhibit challenges in identifying low-contrast materials and typically require large amounts of training data. Here, we present a deep learning model, called MaskTerial, that uses an instance segmentation network to reliably identify 2D material flakes. The model is extensively pre-trained using a synthetic data generator, that generates realistic microscopy images from unlabeled data. This results in a model that can to quickly adapt to new materials with as little as 5 to 10 images. Furthermore, an uncertainty estimation model is used to finally classify the predictions based on optical contrast. We evaluate our method on eight different datasets comprising five different 2D materials and demonstrate significant improvements over existing techniques in the detection of low-contrast materials such as hexagonal boron nitride. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_09333 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | MaskTerial: A Foundation Model for Automated 2D Material Flake Detection Uslu, Jan-Lucas Nekrasov, Alexey Hermans, Alexander Beschoten, Bernd Leibe, Bastian Waldecker, Lutz Stampfer, Christoph Computer Vision and Pattern Recognition Materials Science Image and Video Processing The detection and classification of exfoliated two-dimensional (2D) material flakes from optical microscope images can be automated using computer vision algorithms. This has the potential to increase the accuracy and objectivity of classification and the efficiency of sample fabrication, and it allows for large-scale data collection. Existing algorithms often exhibit challenges in identifying low-contrast materials and typically require large amounts of training data. Here, we present a deep learning model, called MaskTerial, that uses an instance segmentation network to reliably identify 2D material flakes. The model is extensively pre-trained using a synthetic data generator, that generates realistic microscopy images from unlabeled data. This results in a model that can to quickly adapt to new materials with as little as 5 to 10 images. Furthermore, an uncertainty estimation model is used to finally classify the predictions based on optical contrast. We evaluate our method on eight different datasets comprising five different 2D materials and demonstrate significant improvements over existing techniques in the detection of low-contrast materials such as hexagonal boron nitride. |
| title | MaskTerial: A Foundation Model for Automated 2D Material Flake Detection |
| topic | Computer Vision and Pattern Recognition Materials Science Image and Video Processing |
| url | https://arxiv.org/abs/2412.09333 |