MAPSeg: Unified Unsupervised Domain Adaptation for Heterogeneous Medical Image Segmentation Based on 3D Masked Autoencoding and Pseudo-Labeling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Xuzhe, Wu, Yuhao, Angelini, Elsa, Li, Ang, Guo, Jia, Rasmussen, Jerod M., O'Connor, Thomas G., Wadhwa, Pathik D., Jackowski, Andrea Parolin, Li, Hai, Posner, Jonathan, Laine, Andrew F., Wang, Yun
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917626308984832
author Zhang, Xuzhe
Wu, Yuhao
Angelini, Elsa
Li, Ang
Guo, Jia
Rasmussen, Jerod M.
O'Connor, Thomas G.
Wadhwa, Pathik D.
Jackowski, Andrea Parolin
Li, Hai
Posner, Jonathan
Laine, Andrew F.
Wang, Yun
author_facet Zhang, Xuzhe
Wu, Yuhao
Angelini, Elsa
Li, Ang
Guo, Jia
Rasmussen, Jerod M.
O'Connor, Thomas G.
Wadhwa, Pathik D.
Jackowski, Andrea Parolin
Li, Hai
Posner, Jonathan
Laine, Andrew F.
Wang, Yun
contents Robust segmentation is critical for deriving quantitative measures from large-scale, multi-center, and longitudinal medical scans. Manually annotating medical scans, however, is expensive and labor-intensive and may not always be available in every domain. Unsupervised domain adaptation (UDA) is a well-studied technique that alleviates this label-scarcity problem by leveraging available labels from another domain. In this study, we introduce Masked Autoencoding and Pseudo-Labeling Segmentation (MAPSeg), a $\textbf{unified}$ UDA framework with great versatility and superior performance for heterogeneous and volumetric medical image segmentation. To the best of our knowledge, this is the first study that systematically reviews and develops a framework to tackle four different domain shifts in medical image segmentation. More importantly, MAPSeg is the first framework that can be applied to $\textbf{centralized}$, $\textbf{federated}$, and $\textbf{test-time}$ UDA while maintaining comparable performance. We compare MAPSeg with previous state-of-the-art methods on a private infant brain MRI dataset and a public cardiac CT-MRI dataset, and MAPSeg outperforms others by a large margin (10.5 Dice improvement on the private MRI dataset and 5.7 on the public CT-MRI dataset). MAPSeg poses great practical value and can be applied to real-world problems. GitHub: https://github.com/XuzheZ/MAPSeg/.
format Preprint
id arxiv_https___arxiv_org_abs_2303_09373
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle MAPSeg: Unified Unsupervised Domain Adaptation for Heterogeneous Medical Image Segmentation Based on 3D Masked Autoencoding and Pseudo-Labeling
Zhang, Xuzhe
Wu, Yuhao
Angelini, Elsa
Li, Ang
Guo, Jia
Rasmussen, Jerod M.
O'Connor, Thomas G.
Wadhwa, Pathik D.
Jackowski, Andrea Parolin
Li, Hai
Posner, Jonathan
Laine, Andrew F.
Wang, Yun
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Robust segmentation is critical for deriving quantitative measures from large-scale, multi-center, and longitudinal medical scans. Manually annotating medical scans, however, is expensive and labor-intensive and may not always be available in every domain. Unsupervised domain adaptation (UDA) is a well-studied technique that alleviates this label-scarcity problem by leveraging available labels from another domain. In this study, we introduce Masked Autoencoding and Pseudo-Labeling Segmentation (MAPSeg), a $\textbf{unified}$ UDA framework with great versatility and superior performance for heterogeneous and volumetric medical image segmentation. To the best of our knowledge, this is the first study that systematically reviews and develops a framework to tackle four different domain shifts in medical image segmentation. More importantly, MAPSeg is the first framework that can be applied to $\textbf{centralized}$, $\textbf{federated}$, and $\textbf{test-time}$ UDA while maintaining comparable performance. We compare MAPSeg with previous state-of-the-art methods on a private infant brain MRI dataset and a public cardiac CT-MRI dataset, and MAPSeg outperforms others by a large margin (10.5 Dice improvement on the private MRI dataset and 5.7 on the public CT-MRI dataset). MAPSeg poses great practical value and can be applied to real-world problems. GitHub: https://github.com/XuzheZ/MAPSeg/.
title MAPSeg: Unified Unsupervised Domain Adaptation for Heterogeneous Medical Image Segmentation Based on 3D Masked Autoencoding and Pseudo-Labeling
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2303.09373