SAMed-2: Selective Memory Enhanced Medical Segment Anything Model
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916826291634176 |
|---|---|
| author | Yan, Zhiling Song, Sifan Song, Dingjie Li, Yiwei Zhou, Rong Sun, Weixiang Chen, Zhennong Kim, Sekeun Ren, Hui Liu, Tianming Li, Quanzheng Li, Xiang He, Lifang Sun, Lichao |
| author_facet | Yan, Zhiling Song, Sifan Song, Dingjie Li, Yiwei Zhou, Rong Sun, Weixiang Chen, Zhennong Kim, Sekeun Ren, Hui Liu, Tianming Li, Quanzheng Li, Xiang He, Lifang Sun, Lichao |
| contents | Recent "segment anything" efforts show promise by learning from large-scale data, but adapting such models directly to medical images remains challenging due to the complexity of medical data, noisy annotations, and continual learning requirements across diverse modalities and anatomical structures. In this work, we propose SAMed-2, a new foundation model for medical image segmentation built upon the SAM-2 architecture. Specifically, we introduce a temporal adapter into the image encoder to capture image correlations and a confidence-driven memory mechanism to store high-certainty features for later retrieval. This memory-based strategy counters the pervasive noise in large-scale medical datasets and mitigates catastrophic forgetting when encountering new tasks or modalities. To train and evaluate SAMed-2, we curate MedBank-100k, a comprehensive dataset spanning seven imaging modalities and 21 medical segmentation tasks. Our experiments on both internal benchmarks and 10 external datasets demonstrate superior performance over state-of-the-art baselines in multi-task scenarios. The code is available at: https://github.com/ZhilingYan/Medical-SAM-Bench. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_03698 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | SAMed-2: Selective Memory Enhanced Medical Segment Anything Model Yan, Zhiling Song, Sifan Song, Dingjie Li, Yiwei Zhou, Rong Sun, Weixiang Chen, Zhennong Kim, Sekeun Ren, Hui Liu, Tianming Li, Quanzheng Li, Xiang He, Lifang Sun, Lichao Computer Vision and Pattern Recognition Recent "segment anything" efforts show promise by learning from large-scale data, but adapting such models directly to medical images remains challenging due to the complexity of medical data, noisy annotations, and continual learning requirements across diverse modalities and anatomical structures. In this work, we propose SAMed-2, a new foundation model for medical image segmentation built upon the SAM-2 architecture. Specifically, we introduce a temporal adapter into the image encoder to capture image correlations and a confidence-driven memory mechanism to store high-certainty features for later retrieval. This memory-based strategy counters the pervasive noise in large-scale medical datasets and mitigates catastrophic forgetting when encountering new tasks or modalities. To train and evaluate SAMed-2, we curate MedBank-100k, a comprehensive dataset spanning seven imaging modalities and 21 medical segmentation tasks. Our experiments on both internal benchmarks and 10 external datasets demonstrate superior performance over state-of-the-art baselines in multi-task scenarios. The code is available at: https://github.com/ZhilingYan/Medical-SAM-Bench. |
| title | SAMed-2: Selective Memory Enhanced Medical Segment Anything Model |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2507.03698 |