SAM & SAM 2 in 3D Slicer: SegmentWithSAM Extension for Annotating Medical Images

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yildiz, Zafer, Chen, Yuwen, Mazurowski, Maciej A.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914925780140032
author Yildiz, Zafer
Chen, Yuwen
Mazurowski, Maciej A.
author_facet Yildiz, Zafer
Chen, Yuwen
Mazurowski, Maciej A.
contents Creating annotations for 3D medical data is time-consuming and often requires highly specialized expertise. Various tools have been implemented to aid this process. Segment Anything Model 2 (SAM 2) offers a general-purpose prompt-based segmentation algorithm designed to annotate videos. In this paper, we adapt this model to the annotation of 3D medical images and offer our implementation in the form of an extension to the popular annotation software: 3D Slicer. Our extension allows users to place point prompts on 2D slices to generate annotation masks and propagate these annotations across entire volumes in either single-directional or bi-directional manners. Our code is publicly available on https://github.com/mazurowski-lab/SlicerSegmentWithSAM and can be easily installed directly from the Extension Manager of 3D Slicer as well.
format Preprint
id arxiv_https___arxiv_org_abs_2408_15224
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SAM & SAM 2 in 3D Slicer: SegmentWithSAM Extension for Annotating Medical Images
Yildiz, Zafer
Chen, Yuwen
Mazurowski, Maciej A.
Image and Video Processing
Computer Vision and Pattern Recognition
Software Engineering
Creating annotations for 3D medical data is time-consuming and often requires highly specialized expertise. Various tools have been implemented to aid this process. Segment Anything Model 2 (SAM 2) offers a general-purpose prompt-based segmentation algorithm designed to annotate videos. In this paper, we adapt this model to the annotation of 3D medical images and offer our implementation in the form of an extension to the popular annotation software: 3D Slicer. Our extension allows users to place point prompts on 2D slices to generate annotation masks and propagate these annotations across entire volumes in either single-directional or bi-directional manners. Our code is publicly available on https://github.com/mazurowski-lab/SlicerSegmentWithSAM and can be easily installed directly from the Extension Manager of 3D Slicer as well.
title SAM & SAM 2 in 3D Slicer: SegmentWithSAM Extension for Annotating Medical Images
topic Image and Video Processing
Computer Vision and Pattern Recognition
Software Engineering
url https://arxiv.org/abs/2408.15224