Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Jiang, Runmin, Fan, Zhaoxin, Wu, Junhao, Zhu, Lenghan, Huang, Xin, Wang, Tianyang, Huang, Heng, Xu, Min
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911014159646720
author Jiang, Runmin
Fan, Zhaoxin
Wu, Junhao
Zhu, Lenghan
Huang, Xin
Wang, Tianyang
Huang, Heng
Xu, Min
author_facet Jiang, Runmin
Fan, Zhaoxin
Wu, Junhao
Zhu, Lenghan
Huang, Xin
Wang, Tianyang
Huang, Heng
Xu, Min
contents 3D medical image segmentation is a challenging task with crucial implications for disease diagnosis and treatment planning. Recent advances in deep learning have significantly enhanced fully supervised medical image segmentation. However, this approach heavily relies on labor-intensive and time-consuming fully annotated ground-truth labels, particularly for 3D volumes. To overcome this limitation, we propose a novel probabilistic-aware weakly supervised learning pipeline, specifically designed for 3D medical imaging. Our pipeline integrates three innovative components: a Probability-based Pseudo Label Generation technique for synthesizing dense segmentation masks from sparse annotations, a Probabilistic Multi-head Self-Attention network for robust feature extraction within our Probabilistic Transformer Network, and a Probability-informed Segmentation Loss Function to enhance training with annotation confidence. Demonstrating significant advances, our approach not only rivals the performance of fully supervised methods but also surpasses existing weakly supervised methods in CT and MRI datasets, achieving up to 18.1% improvement in Dice scores for certain organs. The code is available at https://github.com/runminjiang/PW4MedSeg.
format Preprint
id arxiv_https___arxiv_org_abs_2403_02566
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learning
Jiang, Runmin
Fan, Zhaoxin
Wu, Junhao
Zhu, Lenghan
Huang, Xin
Wang, Tianyang
Huang, Heng
Xu, Min
Image and Video Processing
Computer Vision and Pattern Recognition
3D medical image segmentation is a challenging task with crucial implications for disease diagnosis and treatment planning. Recent advances in deep learning have significantly enhanced fully supervised medical image segmentation. However, this approach heavily relies on labor-intensive and time-consuming fully annotated ground-truth labels, particularly for 3D volumes. To overcome this limitation, we propose a novel probabilistic-aware weakly supervised learning pipeline, specifically designed for 3D medical imaging. Our pipeline integrates three innovative components: a Probability-based Pseudo Label Generation technique for synthesizing dense segmentation masks from sparse annotations, a Probabilistic Multi-head Self-Attention network for robust feature extraction within our Probabilistic Transformer Network, and a Probability-informed Segmentation Loss Function to enhance training with annotation confidence. Demonstrating significant advances, our approach not only rivals the performance of fully supervised methods but also surpasses existing weakly supervised methods in CT and MRI datasets, achieving up to 18.1% improvement in Dice scores for certain organs. The code is available at https://github.com/runminjiang/PW4MedSeg.
title Enhancing Weakly Supervised 3D Medical Image Segmentation through Probabilistic-aware Learning
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.02566