Synthetically Enhanced: Unveiling Synthetic Data's Potential in Medical Imaging Research

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Khosravi, Bardia, Li, Frank, Dapamede, Theo, Rouzrokh, Pouria, Gamble, Cooper U., Trivedi, Hari M., Wyles, Cody C., Sellergren, Andrew B., Purkayastha, Saptarshi, Erickson, Bradley J., Gichoya, Judy W.
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916314572914688
author Khosravi, Bardia
Li, Frank
Dapamede, Theo
Rouzrokh, Pouria
Gamble, Cooper U.
Trivedi, Hari M.
Wyles, Cody C.
Sellergren, Andrew B.
Purkayastha, Saptarshi
Erickson, Bradley J.
Gichoya, Judy W.
author_facet Khosravi, Bardia
Li, Frank
Dapamede, Theo
Rouzrokh, Pouria
Gamble, Cooper U.
Trivedi, Hari M.
Wyles, Cody C.
Sellergren, Andrew B.
Purkayastha, Saptarshi
Erickson, Bradley J.
Gichoya, Judy W.
contents Chest X-rays (CXR) are essential for diagnosing a variety of conditions, but when used on new populations, model generalizability issues limit their efficacy. Generative AI, particularly denoising diffusion probabilistic models (DDPMs), offers a promising approach to generating synthetic images, enhancing dataset diversity. This study investigates the impact of synthetic data supplementation on the performance and generalizability of medical imaging research. The study employed DDPMs to create synthetic CXRs conditioned on demographic and pathological characteristics from the CheXpert dataset. These synthetic images were used to supplement training datasets for pathology classifiers, with the aim of improving their performance. The evaluation involved three datasets (CheXpert, MIMIC-CXR, and Emory Chest X-ray) and various experiments, including supplementing real data with synthetic data, training with purely synthetic data, and mixing synthetic data with external datasets. Performance was assessed using the area under the receiver operating curve (AUROC). Adding synthetic data to real datasets resulted in a notable increase in AUROC values (up to 0.02 in internal and external test sets with 1000% supplementation, p-value less than 0.01 in all instances). When classifiers were trained exclusively on synthetic data, they achieved performance levels comparable to those trained on real data with 200%-300% data supplementation. The combination of real and synthetic data from different sources demonstrated enhanced model generalizability, increasing model AUROC from 0.76 to 0.80 on the internal test set (p-value less than 0.01). In conclusion, synthetic data supplementation significantly improves the performance and generalizability of pathology classifiers in medical imaging.
format Preprint
id arxiv_https___arxiv_org_abs_2311_09402
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Synthetically Enhanced: Unveiling Synthetic Data's Potential in Medical Imaging Research
Khosravi, Bardia
Li, Frank
Dapamede, Theo
Rouzrokh, Pouria
Gamble, Cooper U.
Trivedi, Hari M.
Wyles, Cody C.
Sellergren, Andrew B.
Purkayastha, Saptarshi
Erickson, Bradley J.
Gichoya, Judy W.
Computer Vision and Pattern Recognition
Machine Learning
Chest X-rays (CXR) are essential for diagnosing a variety of conditions, but when used on new populations, model generalizability issues limit their efficacy. Generative AI, particularly denoising diffusion probabilistic models (DDPMs), offers a promising approach to generating synthetic images, enhancing dataset diversity. This study investigates the impact of synthetic data supplementation on the performance and generalizability of medical imaging research. The study employed DDPMs to create synthetic CXRs conditioned on demographic and pathological characteristics from the CheXpert dataset. These synthetic images were used to supplement training datasets for pathology classifiers, with the aim of improving their performance. The evaluation involved three datasets (CheXpert, MIMIC-CXR, and Emory Chest X-ray) and various experiments, including supplementing real data with synthetic data, training with purely synthetic data, and mixing synthetic data with external datasets. Performance was assessed using the area under the receiver operating curve (AUROC). Adding synthetic data to real datasets resulted in a notable increase in AUROC values (up to 0.02 in internal and external test sets with 1000% supplementation, p-value less than 0.01 in all instances). When classifiers were trained exclusively on synthetic data, they achieved performance levels comparable to those trained on real data with 200%-300% data supplementation. The combination of real and synthetic data from different sources demonstrated enhanced model generalizability, increasing model AUROC from 0.76 to 0.80 on the internal test set (p-value less than 0.01). In conclusion, synthetic data supplementation significantly improves the performance and generalizability of pathology classifiers in medical imaging.
title Synthetically Enhanced: Unveiling Synthetic Data's Potential in Medical Imaging Research
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2311.09402