Generative Adversarial Networks for Weakly Supervised Generation and Evaluation of Brain Tumor Segmentations on MR Images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yoo, Jay J., Namdar, Khashayar, Wagner, Matthias W., Nobre, Liana, Tabori, Uri, Hawkins, Cynthia, Ertl-Wagner, Birgit B., Khalvati, Farzad
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913468794273792
author Yoo, Jay J.
Namdar, Khashayar
Wagner, Matthias W.
Nobre, Liana
Tabori, Uri
Hawkins, Cynthia
Ertl-Wagner, Birgit B.
Khalvati, Farzad
author_facet Yoo, Jay J.
Namdar, Khashayar
Wagner, Matthias W.
Nobre, Liana
Tabori, Uri
Hawkins, Cynthia
Ertl-Wagner, Birgit B.
Khalvati, Farzad
contents Segmentation of regions of interest (ROIs) for identifying abnormalities is a leading problem in medical imaging. Using machine learning for this problem generally requires manually annotated ground-truth segmentations, demanding extensive time and resources from radiologists. This work presents a weakly supervised approach that utilizes binary image-level labels, which are much simpler to acquire, to effectively segment anomalies in 2D magnetic resonance images without ground truth annotations. We train a generative adversarial network (GAN) that converts cancerous images to healthy variants, which are used along with localization seeds as priors to generate improved weakly supervised segmentations. The non-cancerous variants can also be used to evaluate the segmentations in a weakly supervised fashion, which allows for the most effective segmentations to be identified and then applied to downstream clinical classification tasks. On the Multimodal Brain Tumor Segmentation (BraTS) 2020 dataset, our proposed method generates and identifies segmentations that achieve test Dice coefficients of 83.91%. Using these segmentations for pathology classification results with a test AUC of 93.32% which is comparable to the test AUC of 95.80% achieved when using true segmentations.
format Preprint
id arxiv_https___arxiv_org_abs_2211_05269
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Generative Adversarial Networks for Weakly Supervised Generation and Evaluation of Brain Tumor Segmentations on MR Images
Yoo, Jay J.
Namdar, Khashayar
Wagner, Matthias W.
Nobre, Liana
Tabori, Uri
Hawkins, Cynthia
Ertl-Wagner, Birgit B.
Khalvati, Farzad
Image and Video Processing
Computer Vision and Pattern Recognition
Segmentation of regions of interest (ROIs) for identifying abnormalities is a leading problem in medical imaging. Using machine learning for this problem generally requires manually annotated ground-truth segmentations, demanding extensive time and resources from radiologists. This work presents a weakly supervised approach that utilizes binary image-level labels, which are much simpler to acquire, to effectively segment anomalies in 2D magnetic resonance images without ground truth annotations. We train a generative adversarial network (GAN) that converts cancerous images to healthy variants, which are used along with localization seeds as priors to generate improved weakly supervised segmentations. The non-cancerous variants can also be used to evaluate the segmentations in a weakly supervised fashion, which allows for the most effective segmentations to be identified and then applied to downstream clinical classification tasks. On the Multimodal Brain Tumor Segmentation (BraTS) 2020 dataset, our proposed method generates and identifies segmentations that achieve test Dice coefficients of 83.91%. Using these segmentations for pathology classification results with a test AUC of 93.32% which is comparable to the test AUC of 95.80% achieved when using true segmentations.
title Generative Adversarial Networks for Weakly Supervised Generation and Evaluation of Brain Tumor Segmentations on MR Images
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2211.05269