SPIRONet: Spatial-Frequency Learning and Topological Channel Interaction Network for Vessel Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, De-Xing, Zhou, Xiao-Hu, Xie, Xiao-Liang, Liu, Shi-Qi, Wang, Shuang-Yi, Feng, Zhen-Qiu, Gui, Mei-Jiang, Li, Hao, Xiang, Tian-Yu, Yao, Bo-Xian, Hou, Zeng-Guang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913407240765440
author Huang, De-Xing
Zhou, Xiao-Hu
Xie, Xiao-Liang
Liu, Shi-Qi
Wang, Shuang-Yi
Feng, Zhen-Qiu
Gui, Mei-Jiang
Li, Hao
Xiang, Tian-Yu
Yao, Bo-Xian
Hou, Zeng-Guang
author_facet Huang, De-Xing
Zhou, Xiao-Hu
Xie, Xiao-Liang
Liu, Shi-Qi
Wang, Shuang-Yi
Feng, Zhen-Qiu
Gui, Mei-Jiang
Li, Hao
Xiang, Tian-Yu
Yao, Bo-Xian
Hou, Zeng-Guang
contents Automatic vessel segmentation is paramount for developing next-generation interventional navigation systems. However, current approaches suffer from suboptimal segmentation performances due to significant challenges in intraoperative images (i.e., low signal-to-noise ratio, small or slender vessels, and strong interference). In this paper, a novel spatial-frequency learning and topological channel interaction network (SPIRONet) is proposed to address the above issues. Specifically, dual encoders are utilized to comprehensively capture local spatial and global frequency vessel features. Then, a cross-attention fusion module is introduced to effectively fuse spatial and frequency features, thereby enhancing feature discriminability. Furthermore, a topological channel interaction module is designed to filter out task-irrelevant responses based on graph neural networks. Extensive experimental results on several challenging datasets (CADSA, CAXF, DCA1, and XCAD) demonstrate state-of-the-art performances of our method. Moreover, the inference speed of SPIRONet is 21 FPS with a 512x512 input size, surpassing clinical real-time requirements (6~12FPS). These promising outcomes indicate SPIRONet's potential for integration into vascular interventional navigation systems. Code is available at https://github.com/Dxhuang-CASIA/SPIRONet.
format Preprint
id arxiv_https___arxiv_org_abs_2406_19749
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SPIRONet: Spatial-Frequency Learning and Topological Channel Interaction Network for Vessel Segmentation
Huang, De-Xing
Zhou, Xiao-Hu
Xie, Xiao-Liang
Liu, Shi-Qi
Wang, Shuang-Yi
Feng, Zhen-Qiu
Gui, Mei-Jiang
Li, Hao
Xiang, Tian-Yu
Yao, Bo-Xian
Hou, Zeng-Guang
Image and Video Processing
Computer Vision and Pattern Recognition
Automatic vessel segmentation is paramount for developing next-generation interventional navigation systems. However, current approaches suffer from suboptimal segmentation performances due to significant challenges in intraoperative images (i.e., low signal-to-noise ratio, small or slender vessels, and strong interference). In this paper, a novel spatial-frequency learning and topological channel interaction network (SPIRONet) is proposed to address the above issues. Specifically, dual encoders are utilized to comprehensively capture local spatial and global frequency vessel features. Then, a cross-attention fusion module is introduced to effectively fuse spatial and frequency features, thereby enhancing feature discriminability. Furthermore, a topological channel interaction module is designed to filter out task-irrelevant responses based on graph neural networks. Extensive experimental results on several challenging datasets (CADSA, CAXF, DCA1, and XCAD) demonstrate state-of-the-art performances of our method. Moreover, the inference speed of SPIRONet is 21 FPS with a 512x512 input size, surpassing clinical real-time requirements (6~12FPS). These promising outcomes indicate SPIRONet's potential for integration into vascular interventional navigation systems. Code is available at https://github.com/Dxhuang-CASIA/SPIRONet.
title SPIRONet: Spatial-Frequency Learning and Topological Channel Interaction Network for Vessel Segmentation
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.19749