Quantification and Classification of Carbon Nanotubes in Electron Micrographs using Vision Foundation Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pradeep, Sanjay, Wang, Chen, Dahm, Matthew M., Eldredge, Jeff D., Tsai, Candace S. J.
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918323520798720
author Pradeep, Sanjay
Wang, Chen
Dahm, Matthew M.
Eldredge, Jeff D.
Tsai, Candace S. J.
author_facet Pradeep, Sanjay
Wang, Chen
Dahm, Matthew M.
Eldredge, Jeff D.
Tsai, Candace S. J.
contents Accurate characterization of carbon nanotube morphologies in electron microscopy images is vital for exposure assessment and toxicological studies, yet current workflows rely on slow, subjective manual segmentation. This work presents a unified framework leveraging vision foundation models to automate the quantification and classification of CNTs in electron microscopy images. First, we introduce an interactive quantification tool built on the Segment Anything Model (SAM) that segments particles with near-perfect accuracy using minimal user input. Second, we propose a novel classification pipeline that utilizes these segmentation masks to spatially constrain a DINOv2 vision transformer, extracting features exclusively from particle regions while suppressing background noise. Evaluated on a dataset of 1,800 TEM images, this architecture achieves 95.5% accuracy in distinguishing between four different CNT morphologies, significantly outperforming the current baseline despite using a fraction of the training data. Crucially, this instance-level processing allows the framework to resolve mixed samples, correctly classifying distinct particle types co-existing within a single field of view. These results demonstrate that integrating zero-shot segmentation with self-supervised feature learning enables high-throughput, reproducible nanomaterial analysis, transforming a labor-intensive bottleneck into a scalable, data-driven process.
format Preprint
id arxiv_https___arxiv_org_abs_2601_06673
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Quantification and Classification of Carbon Nanotubes in Electron Micrographs using Vision Foundation Models
Pradeep, Sanjay
Wang, Chen
Dahm, Matthew M.
Eldredge, Jeff D.
Tsai, Candace S. J.
Computer Vision and Pattern Recognition
Accurate characterization of carbon nanotube morphologies in electron microscopy images is vital for exposure assessment and toxicological studies, yet current workflows rely on slow, subjective manual segmentation. This work presents a unified framework leveraging vision foundation models to automate the quantification and classification of CNTs in electron microscopy images. First, we introduce an interactive quantification tool built on the Segment Anything Model (SAM) that segments particles with near-perfect accuracy using minimal user input. Second, we propose a novel classification pipeline that utilizes these segmentation masks to spatially constrain a DINOv2 vision transformer, extracting features exclusively from particle regions while suppressing background noise. Evaluated on a dataset of 1,800 TEM images, this architecture achieves 95.5% accuracy in distinguishing between four different CNT morphologies, significantly outperforming the current baseline despite using a fraction of the training data. Crucially, this instance-level processing allows the framework to resolve mixed samples, correctly classifying distinct particle types co-existing within a single field of view. These results demonstrate that integrating zero-shot segmentation with self-supervised feature learning enables high-throughput, reproducible nanomaterial analysis, transforming a labor-intensive bottleneck into a scalable, data-driven process.
title Quantification and Classification of Carbon Nanotubes in Electron Micrographs using Vision Foundation Models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2601.06673