Translation Consistent Semi-supervised Segmentation for 3D Medical Images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Yuyuan, Tian, Yu, Wang, Chong, Chen, Yuanhong, Liu, Fengbei, Belagiannis, Vasileios, Carneiro, Gustavo
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918042015891456
author Liu, Yuyuan
Tian, Yu
Wang, Chong
Chen, Yuanhong
Liu, Fengbei
Belagiannis, Vasileios
Carneiro, Gustavo
author_facet Liu, Yuyuan
Tian, Yu
Wang, Chong
Chen, Yuanhong
Liu, Fengbei
Belagiannis, Vasileios
Carneiro, Gustavo
contents 3D medical image segmentation methods have been successful, but their dependence on large amounts of voxel-level annotated data is a disadvantage that needs to be addressed given the high cost to obtain such annotation. Semi-supervised learning (SSL) solve this issue by training models with a large unlabelled and a small labelled dataset. The most successful SSL approaches are based on consistency learning that minimises the distance between model responses obtained from perturbed views of the unlabelled data. These perturbations usually keep the spatial input context between views fairly consistent, which may cause the model to learn segmentation patterns from the spatial input contexts instead of the segmented objects. In this paper, we introduce the Translation Consistent Co-training (TraCoCo) which is a consistency learning SSL method that perturbs the input data views by varying their spatial input context, allowing the model to learn segmentation patterns from visual objects. Furthermore, we propose the replacement of the commonly used mean squared error (MSE) semi-supervised loss by a new Cross-model confident Binary Cross entropy (CBC) loss, which improves training convergence and keeps the robustness to co-training pseudo-labelling mistakes. We also extend CutMix augmentation to 3D SSL to further improve generalisation. Our TraCoCo shows state-of-the-art results for the Left Atrium (LA) and Brain Tumor Segmentation (BRaTS19) datasets with different backbones. Our code is available at https://github.com/yyliu01/TraCoCo.
format Preprint
id arxiv_https___arxiv_org_abs_2203_14523
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Translation Consistent Semi-supervised Segmentation for 3D Medical Images
Liu, Yuyuan
Tian, Yu
Wang, Chong
Chen, Yuanhong
Liu, Fengbei
Belagiannis, Vasileios
Carneiro, Gustavo
Computer Vision and Pattern Recognition
Artificial Intelligence
3D medical image segmentation methods have been successful, but their dependence on large amounts of voxel-level annotated data is a disadvantage that needs to be addressed given the high cost to obtain such annotation. Semi-supervised learning (SSL) solve this issue by training models with a large unlabelled and a small labelled dataset. The most successful SSL approaches are based on consistency learning that minimises the distance between model responses obtained from perturbed views of the unlabelled data. These perturbations usually keep the spatial input context between views fairly consistent, which may cause the model to learn segmentation patterns from the spatial input contexts instead of the segmented objects. In this paper, we introduce the Translation Consistent Co-training (TraCoCo) which is a consistency learning SSL method that perturbs the input data views by varying their spatial input context, allowing the model to learn segmentation patterns from visual objects. Furthermore, we propose the replacement of the commonly used mean squared error (MSE) semi-supervised loss by a new Cross-model confident Binary Cross entropy (CBC) loss, which improves training convergence and keeps the robustness to co-training pseudo-labelling mistakes. We also extend CutMix augmentation to 3D SSL to further improve generalisation. Our TraCoCo shows state-of-the-art results for the Left Atrium (LA) and Brain Tumor Segmentation (BRaTS19) datasets with different backbones. Our code is available at https://github.com/yyliu01/TraCoCo.
title Translation Consistent Semi-supervised Segmentation for 3D Medical Images
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2203.14523