Denoising Diffusion Models for 3D Healthy Brain Tissue Inpainting
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914723299065856 |
|---|---|
| author | Durrer, Alicia Wolleb, Julia Bieder, Florentin Friedrich, Paul Melie-Garcia, Lester Ocampo-Pineda, Mario Bercea, Cosmin I. Hamamci, Ibrahim E. Wiestler, Benedikt Piraud, Marie Yaldizli, Özgür Granziera, Cristina Menze, Bjoern H. Cattin, Philippe C. Kofler, Florian |
| author_facet | Durrer, Alicia Wolleb, Julia Bieder, Florentin Friedrich, Paul Melie-Garcia, Lester Ocampo-Pineda, Mario Bercea, Cosmin I. Hamamci, Ibrahim E. Wiestler, Benedikt Piraud, Marie Yaldizli, Özgür Granziera, Cristina Menze, Bjoern H. Cattin, Philippe C. Kofler, Florian |
| contents | Monitoring diseases that affect the brain's structural integrity requires automated analysis of magnetic resonance (MR) images, e.g., for the evaluation of volumetric changes. However, many of the evaluation tools are optimized for analyzing healthy tissue. To enable the evaluation of scans containing pathological tissue, it is therefore required to restore healthy tissue in the pathological areas. In this work, we explore and extend denoising diffusion models for consistent inpainting of healthy 3D brain tissue. We modify state-of-the-art 2D, pseudo-3D, and 3D methods working in the image space, as well as 3D latent and 3D wavelet diffusion models, and train them to synthesize healthy brain tissue. Our evaluation shows that the pseudo-3D model performs best regarding the structural-similarity index, peak signal-to-noise ratio, and mean squared error. To emphasize the clinical relevance, we fine-tune this model on data containing synthetic MS lesions and evaluate it on a downstream brain tissue segmentation task, whereby it outperforms the established FMRIB Software Library (FSL) lesion-filling method. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_14499 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Denoising Diffusion Models for 3D Healthy Brain Tissue Inpainting Durrer, Alicia Wolleb, Julia Bieder, Florentin Friedrich, Paul Melie-Garcia, Lester Ocampo-Pineda, Mario Bercea, Cosmin I. Hamamci, Ibrahim E. Wiestler, Benedikt Piraud, Marie Yaldizli, Özgür Granziera, Cristina Menze, Bjoern H. Cattin, Philippe C. Kofler, Florian Image and Video Processing Computer Vision and Pattern Recognition Monitoring diseases that affect the brain's structural integrity requires automated analysis of magnetic resonance (MR) images, e.g., for the evaluation of volumetric changes. However, many of the evaluation tools are optimized for analyzing healthy tissue. To enable the evaluation of scans containing pathological tissue, it is therefore required to restore healthy tissue in the pathological areas. In this work, we explore and extend denoising diffusion models for consistent inpainting of healthy 3D brain tissue. We modify state-of-the-art 2D, pseudo-3D, and 3D methods working in the image space, as well as 3D latent and 3D wavelet diffusion models, and train them to synthesize healthy brain tissue. Our evaluation shows that the pseudo-3D model performs best regarding the structural-similarity index, peak signal-to-noise ratio, and mean squared error. To emphasize the clinical relevance, we fine-tune this model on data containing synthetic MS lesions and evaluate it on a downstream brain tissue segmentation task, whereby it outperforms the established FMRIB Software Library (FSL) lesion-filling method. |
| title | Denoising Diffusion Models for 3D Healthy Brain Tissue Inpainting |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.14499 |