Segment anything model for head and neck tumor segmentation with CT, PET and MRI multi-modality images
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866929655221583872 |
|---|---|
| author | Ren, Jintao Rasmussen, Mathis Nijkamp, Jasper Eriksen, Jesper Grau Korreman, Stine |
| author_facet | Ren, Jintao Rasmussen, Mathis Nijkamp, Jasper Eriksen, Jesper Grau Korreman, Stine |
| contents | Deep learning presents novel opportunities for the auto-segmentation of gross tumor volume (GTV) in head and neck cancer (HNC), yet fully automatic methods usually necessitate significant manual refinement. This study investigates the Segment Anything Model (SAM), recognized for requiring minimal human prompting and its zero-shot generalization ability across natural images. We specifically examine MedSAM, a version of SAM fine-tuned with large-scale public medical images. Despite its progress, the integration of multi-modality images (CT, PET, MRI) for effective GTV delineation remains a challenge. Focusing on SAM's application in HNC GTV segmentation, we assess its performance in both zero-shot and fine-tuned scenarios using single (CT-only) and fused multi-modality images. Our study demonstrates that fine-tuning SAM significantly enhances its segmentation accuracy, building upon the already effective zero-shot results achieved with bounding box prompts. These findings open a promising avenue for semi-automatic HNC GTV segmentation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_17454 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Segment anything model for head and neck tumor segmentation with CT, PET and MRI multi-modality images Ren, Jintao Rasmussen, Mathis Nijkamp, Jasper Eriksen, Jesper Grau Korreman, Stine Medical Physics Computer Vision and Pattern Recognition Deep learning presents novel opportunities for the auto-segmentation of gross tumor volume (GTV) in head and neck cancer (HNC), yet fully automatic methods usually necessitate significant manual refinement. This study investigates the Segment Anything Model (SAM), recognized for requiring minimal human prompting and its zero-shot generalization ability across natural images. We specifically examine MedSAM, a version of SAM fine-tuned with large-scale public medical images. Despite its progress, the integration of multi-modality images (CT, PET, MRI) for effective GTV delineation remains a challenge. Focusing on SAM's application in HNC GTV segmentation, we assess its performance in both zero-shot and fine-tuned scenarios using single (CT-only) and fused multi-modality images. Our study demonstrates that fine-tuning SAM significantly enhances its segmentation accuracy, building upon the already effective zero-shot results achieved with bounding box prompts. These findings open a promising avenue for semi-automatic HNC GTV segmentation. |
| title | Segment anything model for head and neck tumor segmentation with CT, PET and MRI multi-modality images |
| topic | Medical Physics Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2402.17454 |