Brain Tumour Removing and Missing Modality Generation using 3D WDM

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ferreira, André, Luijten, Gijs, Puladi, Behrus, Kleesiek, Jens, Alves, Victor, Egger, Jan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916502228172800
author Ferreira, André
Luijten, Gijs
Puladi, Behrus
Kleesiek, Jens
Alves, Victor
Egger, Jan
author_facet Ferreira, André
Luijten, Gijs
Puladi, Behrus
Kleesiek, Jens
Alves, Victor
Egger, Jan
contents This paper presents the second-placed solution for task 8 and the participation solution for task 7 of BraTS 2024. The adoption of automated brain analysis algorithms to support clinical practice is increasing. However, many of these algorithms struggle with the presence of brain lesions or the absence of certain MRI modalities. The alterations in the brain's morphology leads to high variability and thus poor performance of predictive models that were trained only on healthy brains. The lack of information that is usually provided by some of the missing MRI modalities also reduces the reliability of the prediction models trained with all modalities. In order to improve the performance of these models, we propose the use of conditional 3D wavelet diffusion models. The wavelet transform enabled full-resolution image training and prediction on a GPU with 48 GB VRAM, without patching or downsampling, preserving all information for prediction. The code for these tasks is available at https://github.com/ShadowTwin41/BraTS_2023_2024_solutions.
format Preprint
id arxiv_https___arxiv_org_abs_2411_04630
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Brain Tumour Removing and Missing Modality Generation using 3D WDM
Ferreira, André
Luijten, Gijs
Puladi, Behrus
Kleesiek, Jens
Alves, Victor
Egger, Jan
Computer Vision and Pattern Recognition
Machine Learning
This paper presents the second-placed solution for task 8 and the participation solution for task 7 of BraTS 2024. The adoption of automated brain analysis algorithms to support clinical practice is increasing. However, many of these algorithms struggle with the presence of brain lesions or the absence of certain MRI modalities. The alterations in the brain's morphology leads to high variability and thus poor performance of predictive models that were trained only on healthy brains. The lack of information that is usually provided by some of the missing MRI modalities also reduces the reliability of the prediction models trained with all modalities. In order to improve the performance of these models, we propose the use of conditional 3D wavelet diffusion models. The wavelet transform enabled full-resolution image training and prediction on a GPU with 48 GB VRAM, without patching or downsampling, preserving all information for prediction. The code for these tasks is available at https://github.com/ShadowTwin41/BraTS_2023_2024_solutions.
title Brain Tumour Removing and Missing Modality Generation using 3D WDM
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2411.04630