MAE-SAM2: Mask Autoencoder-Enhanced SAM2 for Clinical Retinal Vascular Leakage Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xing, Xin, Karaca, Irmak, Akhavanrezayat, Amir, Badrloo, Samira, Nguyen, Quan Dong, Subramaniam, Mahadevan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913012515864576
author Xing, Xin
Karaca, Irmak
Akhavanrezayat, Amir
Badrloo, Samira
Nguyen, Quan Dong
Subramaniam, Mahadevan
author_facet Xing, Xin
Karaca, Irmak
Akhavanrezayat, Amir
Badrloo, Samira
Nguyen, Quan Dong
Subramaniam, Mahadevan
contents We propose MAE-SAM2, a novel foundation model for retinal vascular leakage segmentation on fluorescein angiography images. Due to the small size and dense distribution of the leakage areas, along with the limited availability of labeled clinical data, this presents a significant challenge for segmentation tasks. Our approach integrates a Self-Supervised learning (SSL) strategy, Masked Autoencoder (MAE), with SAM2. In our implementation, we explore different loss functions and conclude a task-specific combined loss. Extensive experiments and ablation studies demonstrate that MAE-SAM2 outperforms several state-of-the-art models, achieving the highest Dice score and Intersection-over-Union (IoU). Compared to the original SAM2, our model achieves a $5\%$ performance improvement, highlighting the promise of foundation models with self-supervised pretraining in clinical imaging tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2509_10554
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MAE-SAM2: Mask Autoencoder-Enhanced SAM2 for Clinical Retinal Vascular Leakage Segmentation
Xing, Xin
Karaca, Irmak
Akhavanrezayat, Amir
Badrloo, Samira
Nguyen, Quan Dong
Subramaniam, Mahadevan
Tissues and Organs
Computer Vision and Pattern Recognition
Image and Video Processing
We propose MAE-SAM2, a novel foundation model for retinal vascular leakage segmentation on fluorescein angiography images. Due to the small size and dense distribution of the leakage areas, along with the limited availability of labeled clinical data, this presents a significant challenge for segmentation tasks. Our approach integrates a Self-Supervised learning (SSL) strategy, Masked Autoencoder (MAE), with SAM2. In our implementation, we explore different loss functions and conclude a task-specific combined loss. Extensive experiments and ablation studies demonstrate that MAE-SAM2 outperforms several state-of-the-art models, achieving the highest Dice score and Intersection-over-Union (IoU). Compared to the original SAM2, our model achieves a $5\%$ performance improvement, highlighting the promise of foundation models with self-supervised pretraining in clinical imaging tasks.
title MAE-SAM2: Mask Autoencoder-Enhanced SAM2 for Clinical Retinal Vascular Leakage Segmentation
topic Tissues and Organs
Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2509.10554