VasoMIM: Vascular Anatomy-Aware Masked Image Modeling for Vessel Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, De-Xing, Zhou, Xiao-Hu, Gui, Mei-Jiang, Xie, Xiao-Liang, Liu, Shi-Qi, Wang, Shuang-Yi, Xiang, Tian-Yu, Ma, Rui-Ze, Xiao, Nu-Fang, Hou, Zeng-Guang
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908649715138560
author Huang, De-Xing
Zhou, Xiao-Hu
Gui, Mei-Jiang
Xie, Xiao-Liang
Liu, Shi-Qi
Wang, Shuang-Yi
Xiang, Tian-Yu
Ma, Rui-Ze
Xiao, Nu-Fang
Hou, Zeng-Guang
author_facet Huang, De-Xing
Zhou, Xiao-Hu
Gui, Mei-Jiang
Xie, Xiao-Liang
Liu, Shi-Qi
Wang, Shuang-Yi
Xiang, Tian-Yu
Ma, Rui-Ze
Xiao, Nu-Fang
Hou, Zeng-Guang
contents Accurate vessel segmentation in X-ray angiograms is crucial for numerous clinical applications. However, the scarcity of annotated data presents a significant challenge, which has driven the adoption of self-supervised learning (SSL) methods such as masked image modeling (MIM) to leverage large-scale unlabeled data for learning transferable representations. Unfortunately, conventional MIM often fails to capture vascular anatomy because of the severe class imbalance between vessel and background pixels, leading to weak vascular representations. To address this, we introduce Vascular anatomy-aware Masked Image Modeling (VasoMIM), a novel MIM framework tailored for X-ray angiograms that explicitly integrates anatomical knowledge into the pre-training process. Specifically, it comprises two complementary components: anatomy-guided masking strategy and anatomical consistency loss. The former preferentially masks vessel-containing patches to focus the model on reconstructing vessel-relevant regions. The latter enforces consistency in vascular semantics between the original and reconstructed images, thereby improving the discriminability of vascular representations. Empirically, VasoMIM achieves state-of-the-art performance across three datasets. These findings highlight its potential to facilitate X-ray angiogram analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2508_10794
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VasoMIM: Vascular Anatomy-Aware Masked Image Modeling for Vessel Segmentation
Huang, De-Xing
Zhou, Xiao-Hu
Gui, Mei-Jiang
Xie, Xiao-Liang
Liu, Shi-Qi
Wang, Shuang-Yi
Xiang, Tian-Yu
Ma, Rui-Ze
Xiao, Nu-Fang
Hou, Zeng-Guang
Computer Vision and Pattern Recognition
Accurate vessel segmentation in X-ray angiograms is crucial for numerous clinical applications. However, the scarcity of annotated data presents a significant challenge, which has driven the adoption of self-supervised learning (SSL) methods such as masked image modeling (MIM) to leverage large-scale unlabeled data for learning transferable representations. Unfortunately, conventional MIM often fails to capture vascular anatomy because of the severe class imbalance between vessel and background pixels, leading to weak vascular representations. To address this, we introduce Vascular anatomy-aware Masked Image Modeling (VasoMIM), a novel MIM framework tailored for X-ray angiograms that explicitly integrates anatomical knowledge into the pre-training process. Specifically, it comprises two complementary components: anatomy-guided masking strategy and anatomical consistency loss. The former preferentially masks vessel-containing patches to focus the model on reconstructing vessel-relevant regions. The latter enforces consistency in vascular semantics between the original and reconstructed images, thereby improving the discriminability of vascular representations. Empirically, VasoMIM achieves state-of-the-art performance across three datasets. These findings highlight its potential to facilitate X-ray angiogram analysis.
title VasoMIM: Vascular Anatomy-Aware Masked Image Modeling for Vessel Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.10794