MedSAM2: Segment Anything in 3D Medical Images and Videos

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ma, Jun, Yang, Zongxin, Kim, Sumin, Chen, Bihui, Baharoon, Mohammed, Fallahpour, Adibvafa, Asakereh, Reza, Lyu, Hongwei, Wang, Bo
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916674214559744
author Ma, Jun
Yang, Zongxin
Kim, Sumin
Chen, Bihui
Baharoon, Mohammed
Fallahpour, Adibvafa
Asakereh, Reza
Lyu, Hongwei
Wang, Bo
author_facet Ma, Jun
Yang, Zongxin
Kim, Sumin
Chen, Bihui
Baharoon, Mohammed
Fallahpour, Adibvafa
Asakereh, Reza
Lyu, Hongwei
Wang, Bo
contents Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies on building general-purpose models for 3D images and videos with comprehensive user studies. Here, we present MedSAM2, a promptable segmentation foundation model for 3D image and video segmentation. The model is developed by fine-tuning the Segment Anything Model 2 on a large medical dataset with over 455,000 3D image-mask pairs and 76,000 frames, outperforming previous models across a wide range of organs, lesions, and imaging modalities. Furthermore, we implement a human-in-the-loop pipeline to facilitate the creation of large-scale datasets resulting in, to the best of our knowledge, the most extensive user study to date, involving the annotation of 5,000 CT lesions, 3,984 liver MRI lesions, and 251,550 echocardiogram video frames, demonstrating that MedSAM2 can reduce manual costs by more than 85%. MedSAM2 is also integrated into widely used platforms with user-friendly interfaces for local and cloud deployment, making it a practical tool for supporting efficient, scalable, and high-quality segmentation in both research and healthcare environments.
format Preprint
id arxiv_https___arxiv_org_abs_2504_03600
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MedSAM2: Segment Anything in 3D Medical Images and Videos
Ma, Jun
Yang, Zongxin
Kim, Sumin
Chen, Bihui
Baharoon, Mohammed
Fallahpour, Adibvafa
Asakereh, Reza
Lyu, Hongwei
Wang, Bo
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Medical image and video segmentation is a critical task for precision medicine, which has witnessed considerable progress in developing task or modality-specific and generalist models for 2D images. However, there have been limited studies on building general-purpose models for 3D images and videos with comprehensive user studies. Here, we present MedSAM2, a promptable segmentation foundation model for 3D image and video segmentation. The model is developed by fine-tuning the Segment Anything Model 2 on a large medical dataset with over 455,000 3D image-mask pairs and 76,000 frames, outperforming previous models across a wide range of organs, lesions, and imaging modalities. Furthermore, we implement a human-in-the-loop pipeline to facilitate the creation of large-scale datasets resulting in, to the best of our knowledge, the most extensive user study to date, involving the annotation of 5,000 CT lesions, 3,984 liver MRI lesions, and 251,550 echocardiogram video frames, demonstrating that MedSAM2 can reduce manual costs by more than 85%. MedSAM2 is also integrated into widely used platforms with user-friendly interfaces for local and cloud deployment, making it a practical tool for supporting efficient, scalable, and high-quality segmentation in both research and healthcare environments.
title MedSAM2: Segment Anything in 3D Medical Images and Videos
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.03600