Detecting Unforeseen Data Properties with Diffusion Autoencoder Embeddings using Spine MRI data

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Graf, Robert, Hunecke, Florian, Pohl, Soeren, Atad, Matan, Moeller, Hendrik, Starck, Sophie, Kroencke, Thomas, Bette, Stefanie, Bamberg, Fabian, Pischon, Tobias, Niendorf, Thoralf, Schmidt, Carsten, Paetzold, Johannes C., Rueckert, Daniel, Kirschke, Jan S
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929540962451456
author Graf, Robert
Hunecke, Florian
Pohl, Soeren
Atad, Matan
Moeller, Hendrik
Starck, Sophie
Kroencke, Thomas
Bette, Stefanie
Bamberg, Fabian
Pischon, Tobias
Niendorf, Thoralf
Schmidt, Carsten
Paetzold, Johannes C.
Rueckert, Daniel
Kirschke, Jan S
author_facet Graf, Robert
Hunecke, Florian
Pohl, Soeren
Atad, Matan
Moeller, Hendrik
Starck, Sophie
Kroencke, Thomas
Bette, Stefanie
Bamberg, Fabian
Pischon, Tobias
Niendorf, Thoralf
Schmidt, Carsten
Paetzold, Johannes C.
Rueckert, Daniel
Kirschke, Jan S
contents Deep learning has made significant strides in medical imaging, leveraging the use of large datasets to improve diagnostics and prognostics. However, large datasets often come with inherent errors through subject selection and acquisition. In this paper, we investigate the use of Diffusion Autoencoder (DAE) embeddings for uncovering and understanding data characteristics and biases, including biases for protected variables like sex and data abnormalities indicative of unwanted protocol variations. We use sagittal T2-weighted magnetic resonance (MR) images of the neck, chest, and lumbar region from 11186 German National Cohort (NAKO) participants. We compare DAE embeddings with existing generative models like StyleGAN and Variational Autoencoder. Evaluations on a large-scale dataset consisting of sagittal T2-weighted MR images of three spine regions show that DAE embeddings effectively separate protected variables such as sex and age. Furthermore, we used t-SNE visualization to identify unwanted variations in imaging protocols, revealing differences in head positioning. Our embedding can identify samples where a sex predictor will have issues learning the correct sex. Our findings highlight the potential of using advanced embedding techniques like DAEs to detect data quality issues and biases in medical imaging datasets. Identifying such hidden relations can enhance the reliability and fairness of deep learning models in healthcare applications, ultimately improving patient care and outcomes.
format Preprint
id arxiv_https___arxiv_org_abs_2410_10220
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Detecting Unforeseen Data Properties with Diffusion Autoencoder Embeddings using Spine MRI data
Graf, Robert
Hunecke, Florian
Pohl, Soeren
Atad, Matan
Moeller, Hendrik
Starck, Sophie
Kroencke, Thomas
Bette, Stefanie
Bamberg, Fabian
Pischon, Tobias
Niendorf, Thoralf
Schmidt, Carsten
Paetzold, Johannes C.
Rueckert, Daniel
Kirschke, Jan S
Computer Vision and Pattern Recognition
Deep learning has made significant strides in medical imaging, leveraging the use of large datasets to improve diagnostics and prognostics. However, large datasets often come with inherent errors through subject selection and acquisition. In this paper, we investigate the use of Diffusion Autoencoder (DAE) embeddings for uncovering and understanding data characteristics and biases, including biases for protected variables like sex and data abnormalities indicative of unwanted protocol variations. We use sagittal T2-weighted magnetic resonance (MR) images of the neck, chest, and lumbar region from 11186 German National Cohort (NAKO) participants. We compare DAE embeddings with existing generative models like StyleGAN and Variational Autoencoder. Evaluations on a large-scale dataset consisting of sagittal T2-weighted MR images of three spine regions show that DAE embeddings effectively separate protected variables such as sex and age. Furthermore, we used t-SNE visualization to identify unwanted variations in imaging protocols, revealing differences in head positioning. Our embedding can identify samples where a sex predictor will have issues learning the correct sex. Our findings highlight the potential of using advanced embedding techniques like DAEs to detect data quality issues and biases in medical imaging datasets. Identifying such hidden relations can enhance the reliability and fairness of deep learning models in healthcare applications, ultimately improving patient care and outcomes.
title Detecting Unforeseen Data Properties with Diffusion Autoencoder Embeddings using Spine MRI data
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.10220