Efficient MedSAMs: Segment Anything in Medical Images on Laptop

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ma, Jun, Li, Feifei, Kim, Sumin, Asakereh, Reza, Le, Bao-Hiep, Nguyen-Vu, Dang-Khoa, Pfefferle, Alexander, Wei, Muxin, Gao, Ruochen, Lyu, Donghang, Yang, Songxiao, Purucker, Lennart, Marinov, Zdravko, Staring, Marius, Lu, Haisheng, Dao, Thuy Thanh, Ye, Xincheng, Li, Zhi, Brugnara, Gianluca, Vollmuth, Philipp, Foltyn-Dumitru, Martha, Cho, Jaeyoung, Mahmutoglu, Mustafa Ahmed, Bendszus, Martin, Pflüger, Irada, Rastogi, Aditya, Ni, Dong, Yang, Xin, Zhou, Guang-Quan, Wang, Kaini, Heller, Nicholas, Papanikolopoulos, Nikolaos, Weight, Christopher, Tong, Yubing, Udupa, Jayaram K, Patrick, Cahill J., Wang, Yaqi, Zhang, Yifan, Contijoch, Francisco, McVeigh, Elliot, Ye, Xin, He, Shucheng, Haase, Robert, Pinetz, Thomas, Radbruch, Alexander, Krause, Inga, Kobler, Erich, He, Jian, Tang, Yucheng, Yang, Haichun, Huo, Yuankai, Luo, Gongning, Kushibar, Kaisar, Amankulov, Jandos, Toleshbayev, Dias, Mukhamejan, Amangeldi, Egger, Jan, Pepe, Antonio, Gsaxner, Christina, Luijten, Gijs, Fujita, Shohei, Kikuchi, Tomohiro, Wiestler, Benedikt, Kirschke, Jan S., de la Rosa, Ezequiel, Bolelli, Federico, Lumetti, Luca, Grana, Costantino, Xie, Kunpeng, Wu, Guomin, Puladi, Behrus, Martín-Isla, Carlos, Lekadir, Karim, Campello, Victor M., Shao, Wei, Brisbane, Wayne, Jiang, Hongxu, Wei, Hao, Yuan, Wu, Li, Shuangle, Zhou, Yuyin, Wang, Bo
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909436552937472
author Ma, Jun
Li, Feifei
Kim, Sumin
Asakereh, Reza
Le, Bao-Hiep
Nguyen-Vu, Dang-Khoa
Pfefferle, Alexander
Wei, Muxin
Gao, Ruochen
Lyu, Donghang
Yang, Songxiao
Purucker, Lennart
Marinov, Zdravko
Staring, Marius
Lu, Haisheng
Dao, Thuy Thanh
Ye, Xincheng
Li, Zhi
Brugnara, Gianluca
Vollmuth, Philipp
Foltyn-Dumitru, Martha
Cho, Jaeyoung
Mahmutoglu, Mustafa Ahmed
Bendszus, Martin
Pflüger, Irada
Rastogi, Aditya
Ni, Dong
Yang, Xin
Zhou, Guang-Quan
Wang, Kaini
Heller, Nicholas
Papanikolopoulos, Nikolaos
Weight, Christopher
Tong, Yubing
Udupa, Jayaram K
Patrick, Cahill J.
Wang, Yaqi
Zhang, Yifan
Contijoch, Francisco
McVeigh, Elliot
Ye, Xin
He, Shucheng
Haase, Robert
Pinetz, Thomas
Radbruch, Alexander
Krause, Inga
Kobler, Erich
He, Jian
Tang, Yucheng
Yang, Haichun
Huo, Yuankai
Luo, Gongning
Kushibar, Kaisar
Amankulov, Jandos
Toleshbayev, Dias
Mukhamejan, Amangeldi
Egger, Jan
Pepe, Antonio
Gsaxner, Christina
Luijten, Gijs
Fujita, Shohei
Kikuchi, Tomohiro
Wiestler, Benedikt
Kirschke, Jan S.
de la Rosa, Ezequiel
Bolelli, Federico
Lumetti, Luca
Grana, Costantino
Xie, Kunpeng
Wu, Guomin
Puladi, Behrus
Martín-Isla, Carlos
Lekadir, Karim
Campello, Victor M.
Shao, Wei
Brisbane, Wayne
Jiang, Hongxu
Wei, Hao
Yuan, Wu
Li, Shuangle
Zhou, Yuyin
Wang, Bo
author_facet Ma, Jun
Li, Feifei
Kim, Sumin
Asakereh, Reza
Le, Bao-Hiep
Nguyen-Vu, Dang-Khoa
Pfefferle, Alexander
Wei, Muxin
Gao, Ruochen
Lyu, Donghang
Yang, Songxiao
Purucker, Lennart
Marinov, Zdravko
Staring, Marius
Lu, Haisheng
Dao, Thuy Thanh
Ye, Xincheng
Li, Zhi
Brugnara, Gianluca
Vollmuth, Philipp
Foltyn-Dumitru, Martha
Cho, Jaeyoung
Mahmutoglu, Mustafa Ahmed
Bendszus, Martin
Pflüger, Irada
Rastogi, Aditya
Ni, Dong
Yang, Xin
Zhou, Guang-Quan
Wang, Kaini
Heller, Nicholas
Papanikolopoulos, Nikolaos
Weight, Christopher
Tong, Yubing
Udupa, Jayaram K
Patrick, Cahill J.
Wang, Yaqi
Zhang, Yifan
Contijoch, Francisco
McVeigh, Elliot
Ye, Xin
He, Shucheng
Haase, Robert
Pinetz, Thomas
Radbruch, Alexander
Krause, Inga
Kobler, Erich
He, Jian
Tang, Yucheng
Yang, Haichun
Huo, Yuankai
Luo, Gongning
Kushibar, Kaisar
Amankulov, Jandos
Toleshbayev, Dias
Mukhamejan, Amangeldi
Egger, Jan
Pepe, Antonio
Gsaxner, Christina
Luijten, Gijs
Fujita, Shohei
Kikuchi, Tomohiro
Wiestler, Benedikt
Kirschke, Jan S.
de la Rosa, Ezequiel
Bolelli, Federico
Lumetti, Luca
Grana, Costantino
Xie, Kunpeng
Wu, Guomin
Puladi, Behrus
Martín-Isla, Carlos
Lekadir, Karim
Campello, Victor M.
Shao, Wei
Brisbane, Wayne
Jiang, Hongxu
Wei, Hao
Yuan, Wu
Li, Shuangle
Zhou, Yuyin
Wang, Bo
contents Promptable segmentation foundation models have emerged as a transformative approach to addressing the diverse needs in medical images, but most existing models require expensive computing, posing a big barrier to their adoption in clinical practice. In this work, we organized the first international competition dedicated to promptable medical image segmentation, featuring a large-scale dataset spanning nine common imaging modalities from over 20 different institutions. The top teams developed lightweight segmentation foundation models and implemented an efficient inference pipeline that substantially reduced computational requirements while maintaining state-of-the-art segmentation accuracy. Moreover, the post-challenge phase advanced the algorithms through the design of performance booster and reproducibility tasks, resulting in improved algorithms and validated reproducibility of the winning solution. Furthermore, the best-performing algorithms have been incorporated into the open-source software with a user-friendly interface to facilitate clinical adoption. The data and code are publicly available to foster the further development of medical image segmentation foundation models and pave the way for impactful real-world applications.
format Preprint
id arxiv_https___arxiv_org_abs_2412_16085
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Efficient MedSAMs: Segment Anything in Medical Images on Laptop
Ma, Jun
Li, Feifei
Kim, Sumin
Asakereh, Reza
Le, Bao-Hiep
Nguyen-Vu, Dang-Khoa
Pfefferle, Alexander
Wei, Muxin
Gao, Ruochen
Lyu, Donghang
Yang, Songxiao
Purucker, Lennart
Marinov, Zdravko
Staring, Marius
Lu, Haisheng
Dao, Thuy Thanh
Ye, Xincheng
Li, Zhi
Brugnara, Gianluca
Vollmuth, Philipp
Foltyn-Dumitru, Martha
Cho, Jaeyoung
Mahmutoglu, Mustafa Ahmed
Bendszus, Martin
Pflüger, Irada
Rastogi, Aditya
Ni, Dong
Yang, Xin
Zhou, Guang-Quan
Wang, Kaini
Heller, Nicholas
Papanikolopoulos, Nikolaos
Weight, Christopher
Tong, Yubing
Udupa, Jayaram K
Patrick, Cahill J.
Wang, Yaqi
Zhang, Yifan
Contijoch, Francisco
McVeigh, Elliot
Ye, Xin
He, Shucheng
Haase, Robert
Pinetz, Thomas
Radbruch, Alexander
Krause, Inga
Kobler, Erich
He, Jian
Tang, Yucheng
Yang, Haichun
Huo, Yuankai
Luo, Gongning
Kushibar, Kaisar
Amankulov, Jandos
Toleshbayev, Dias
Mukhamejan, Amangeldi
Egger, Jan
Pepe, Antonio
Gsaxner, Christina
Luijten, Gijs
Fujita, Shohei
Kikuchi, Tomohiro
Wiestler, Benedikt
Kirschke, Jan S.
de la Rosa, Ezequiel
Bolelli, Federico
Lumetti, Luca
Grana, Costantino
Xie, Kunpeng
Wu, Guomin
Puladi, Behrus
Martín-Isla, Carlos
Lekadir, Karim
Campello, Victor M.
Shao, Wei
Brisbane, Wayne
Jiang, Hongxu
Wei, Hao
Yuan, Wu
Li, Shuangle
Zhou, Yuyin
Wang, Bo
Image and Video Processing
Computer Vision and Pattern Recognition
Promptable segmentation foundation models have emerged as a transformative approach to addressing the diverse needs in medical images, but most existing models require expensive computing, posing a big barrier to their adoption in clinical practice. In this work, we organized the first international competition dedicated to promptable medical image segmentation, featuring a large-scale dataset spanning nine common imaging modalities from over 20 different institutions. The top teams developed lightweight segmentation foundation models and implemented an efficient inference pipeline that substantially reduced computational requirements while maintaining state-of-the-art segmentation accuracy. Moreover, the post-challenge phase advanced the algorithms through the design of performance booster and reproducibility tasks, resulting in improved algorithms and validated reproducibility of the winning solution. Furthermore, the best-performing algorithms have been incorporated into the open-source software with a user-friendly interface to facilitate clinical adoption. The data and code are publicly available to foster the further development of medical image segmentation foundation models and pave the way for impactful real-world applications.
title Efficient MedSAMs: Segment Anything in Medical Images on Laptop
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.16085