Brain tumor segmentation using synthetic MR images -- A comparison of GANs and diffusion models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Akbar, Muhammad Usman, Larsson, Måns, Eklund, Anders
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913186275393536
author Akbar, Muhammad Usman
Larsson, Måns
Eklund, Anders
author_facet Akbar, Muhammad Usman
Larsson, Måns
Eklund, Anders
contents Large annotated datasets are required for training deep learning models, but in medical imaging data sharing is often complicated due to ethics, anonymization and data protection legislation. Generative AI models, such as generative adversarial networks (GANs) and diffusion models, can today produce very realistic synthetic images, and can potentially facilitate data sharing. However, in order to share synthetic medical images it must first be demonstrated that they can be used for training different networks with acceptable performance. Here, we therefore comprehensively evaluate four GANs (progressive GAN, StyleGAN 1-3) and a diffusion model for the task of brain tumor segmentation (using two segmentation networks, U-Net and a Swin transformer). Our results show that segmentation networks trained on synthetic images reach Dice scores that are 80% - 90% of Dice scores when training with real images, but that memorization of the training images can be a problem for diffusion models if the original dataset is too small. Our conclusion is that sharing synthetic medical images is a viable option to sharing real images, but that further work is required. The trained generative models and the generated synthetic images are shared on AIDA data hub
format Preprint
id arxiv_https___arxiv_org_abs_2306_02986
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Brain tumor segmentation using synthetic MR images -- A comparison of GANs and diffusion models
Akbar, Muhammad Usman
Larsson, Måns
Eklund, Anders
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Large annotated datasets are required for training deep learning models, but in medical imaging data sharing is often complicated due to ethics, anonymization and data protection legislation. Generative AI models, such as generative adversarial networks (GANs) and diffusion models, can today produce very realistic synthetic images, and can potentially facilitate data sharing. However, in order to share synthetic medical images it must first be demonstrated that they can be used for training different networks with acceptable performance. Here, we therefore comprehensively evaluate four GANs (progressive GAN, StyleGAN 1-3) and a diffusion model for the task of brain tumor segmentation (using two segmentation networks, U-Net and a Swin transformer). Our results show that segmentation networks trained on synthetic images reach Dice scores that are 80% - 90% of Dice scores when training with real images, but that memorization of the training images can be a problem for diffusion models if the original dataset is too small. Our conclusion is that sharing synthetic medical images is a viable option to sharing real images, but that further work is required. The trained generative models and the generated synthetic images are shared on AIDA data hub
title Brain tumor segmentation using synthetic MR images -- A comparison of GANs and diffusion models
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2306.02986