Boosting Medical Image Classification with Segmentation Foundation Model
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913393303093248 |
|---|---|
| author | Gu, Pengfei Zhao, Zihan Wang, Hongxiao Peng, Yaopeng Zhang, Yizhe Sapkota, Nishchal Wang, Chaoli Chen, Danny Z. |
| author_facet | Gu, Pengfei Zhao, Zihan Wang, Hongxiao Peng, Yaopeng Zhang, Yizhe Sapkota, Nishchal Wang, Chaoli Chen, Danny Z. |
| contents | The Segment Anything Model (SAM) exhibits impressive capabilities in zero-shot segmentation for natural images. Recently, SAM has gained a great deal of attention for its applications in medical image segmentation. However, to our best knowledge, no studies have shown how to harness the power of SAM for medical image classification. To fill this gap and make SAM a true ``foundation model'' for medical image analysis, it is highly desirable to customize SAM specifically for medical image classification. In this paper, we introduce SAMAug-C, an innovative augmentation method based on SAM for augmenting classification datasets by generating variants of the original images. The augmented datasets can be used to train a deep learning classification model, thereby boosting the classification performance. Furthermore, we propose a novel framework that simultaneously processes raw and SAMAug-C augmented image input, capitalizing on the complementary information that is offered by both. Experiments on three public datasets validate the effectiveness of our new approach. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_11026 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Boosting Medical Image Classification with Segmentation Foundation Model Gu, Pengfei Zhao, Zihan Wang, Hongxiao Peng, Yaopeng Zhang, Yizhe Sapkota, Nishchal Wang, Chaoli Chen, Danny Z. Computer Vision and Pattern Recognition Artificial Intelligence The Segment Anything Model (SAM) exhibits impressive capabilities in zero-shot segmentation for natural images. Recently, SAM has gained a great deal of attention for its applications in medical image segmentation. However, to our best knowledge, no studies have shown how to harness the power of SAM for medical image classification. To fill this gap and make SAM a true ``foundation model'' for medical image analysis, it is highly desirable to customize SAM specifically for medical image classification. In this paper, we introduce SAMAug-C, an innovative augmentation method based on SAM for augmenting classification datasets by generating variants of the original images. The augmented datasets can be used to train a deep learning classification model, thereby boosting the classification performance. Furthermore, we propose a novel framework that simultaneously processes raw and SAMAug-C augmented image input, capitalizing on the complementary information that is offered by both. Experiments on three public datasets validate the effectiveness of our new approach. |
| title | Boosting Medical Image Classification with Segmentation Foundation Model |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2406.11026 |