Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhou, Lei, Zhang, Yuzhong, Zhang, Jiadong, Qian, Xuejun, Gong, Chen, Sun, Kun, Ding, Zhongxiang, Wang, Xing, Li, Zhenhui, Liu, Zaiyi, Shen, Dinggang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913465491259392
author Zhou, Lei
Zhang, Yuzhong
Zhang, Jiadong
Qian, Xuejun
Gong, Chen
Sun, Kun
Ding, Zhongxiang
Wang, Xing
Li, Zhenhui
Liu, Zaiyi
Shen, Dinggang
author_facet Zhou, Lei
Zhang, Yuzhong
Zhang, Jiadong
Qian, Xuejun
Gong, Chen
Sun, Kun
Ding, Zhongxiang
Wang, Xing
Li, Zhenhui
Liu, Zaiyi
Shen, Dinggang
contents Automated breast tumor segmentation on the basis of dynamic contrast-enhancement magnetic resonance imaging (DCE-MRI) has shown great promise in clinical practice, particularly for identifying the presence of breast disease. However, accurate segmentation of breast tumor is a challenging task, often necessitating the development of complex networks. To strike an optimal trade-off between computational costs and segmentation performance, we propose a hybrid network via the combination of convolution neural network (CNN) and transformer layers. Specifically, the hybrid network consists of a encoder-decoder architecture by stacking convolution and decovolution layers. Effective 3D transformer layers are then implemented after the encoder subnetworks, to capture global dependencies between the bottleneck features. To improve the efficiency of hybrid network, two parallel encoder subnetworks are designed for the decoder and the transformer layers, respectively. To further enhance the discriminative capability of hybrid network, a prototype learning guided prediction module is proposed, where the category-specified prototypical features are calculated through on-line clustering. All learned prototypical features are finally combined with the features from decoder for tumor mask prediction. The experimental results on private and public DCE-MRI datasets demonstrate that the proposed hybrid network achieves superior performance than the state-of-the-art (SOTA) methods, while maintaining balance between segmentation accuracy and computation cost. Moreover, we demonstrate that automatically generated tumor masks can be effectively applied to identify HER2-positive subtype from HER2-negative subtype with the similar accuracy to the analysis based on manual tumor segmentation. The source code is available at https://github.com/ZhouL-lab/PLHN.
format Preprint
id arxiv_https___arxiv_org_abs_2408_05803
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI
Zhou, Lei
Zhang, Yuzhong
Zhang, Jiadong
Qian, Xuejun
Gong, Chen
Sun, Kun
Ding, Zhongxiang
Wang, Xing
Li, Zhenhui
Liu, Zaiyi
Shen, Dinggang
Image and Video Processing
Computer Vision and Pattern Recognition
Automated breast tumor segmentation on the basis of dynamic contrast-enhancement magnetic resonance imaging (DCE-MRI) has shown great promise in clinical practice, particularly for identifying the presence of breast disease. However, accurate segmentation of breast tumor is a challenging task, often necessitating the development of complex networks. To strike an optimal trade-off between computational costs and segmentation performance, we propose a hybrid network via the combination of convolution neural network (CNN) and transformer layers. Specifically, the hybrid network consists of a encoder-decoder architecture by stacking convolution and decovolution layers. Effective 3D transformer layers are then implemented after the encoder subnetworks, to capture global dependencies between the bottleneck features. To improve the efficiency of hybrid network, two parallel encoder subnetworks are designed for the decoder and the transformer layers, respectively. To further enhance the discriminative capability of hybrid network, a prototype learning guided prediction module is proposed, where the category-specified prototypical features are calculated through on-line clustering. All learned prototypical features are finally combined with the features from decoder for tumor mask prediction. The experimental results on private and public DCE-MRI datasets demonstrate that the proposed hybrid network achieves superior performance than the state-of-the-art (SOTA) methods, while maintaining balance between segmentation accuracy and computation cost. Moreover, we demonstrate that automatically generated tumor masks can be effectively applied to identify HER2-positive subtype from HER2-negative subtype with the similar accuracy to the analysis based on manual tumor segmentation. The source code is available at https://github.com/ZhouL-lab/PLHN.
title Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.05803