A Generalizable Deep Learning System for Cardiac MRI

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Shad, Rohan, Zakka, Cyril, Kaur, Dhamanpreet, Mathur, Mrudang, Fong, Robyn, Cho, Joseph, Filice, Ross Warren, Mongan, John, Kalianos, Kimberly, Khandwala, Nishith, Eng, David, Leipzig, Matthew, Witschey, Walter R., de Feria, Alejandro, Ferrari, Victor A., Ashley, Euan A., Acker, Michael A., Langlotz, Curtis, Hiesinger, William
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908912907714560
author Shad, Rohan
Zakka, Cyril
Kaur, Dhamanpreet
Mathur, Mrudang
Fong, Robyn
Cho, Joseph
Filice, Ross Warren
Mongan, John
Kalianos, Kimberly
Khandwala, Nishith
Eng, David
Leipzig, Matthew
Witschey, Walter R.
de Feria, Alejandro
Ferrari, Victor A.
Ashley, Euan A.
Acker, Michael A.
Langlotz, Curtis
Hiesinger, William
author_facet Shad, Rohan
Zakka, Cyril
Kaur, Dhamanpreet
Mathur, Mrudang
Fong, Robyn
Cho, Joseph
Filice, Ross Warren
Mongan, John
Kalianos, Kimberly
Khandwala, Nishith
Eng, David
Leipzig, Matthew
Witschey, Walter R.
de Feria, Alejandro
Ferrari, Victor A.
Ashley, Euan A.
Acker, Michael A.
Langlotz, Curtis
Hiesinger, William
contents Cardiac MRI allows for a comprehensive assessment of myocardial structure, function and tissue characteristics. Here we describe a foundational vision system for cardiac MRI, capable of representing the breadth of human cardiovascular disease and health. Our deep-learning model is trained via self-supervised contrastive learning, in which visual concepts in cine-sequence cardiac MRI scans are learned from the raw text of the accompanying radiology reports. We train and evaluate our model on data from four large academic clinical institutions in the United States. We additionally showcase the performance of our models on the UK BioBank and two additional publicly available external datasets. We explore emergent capabilities of our system and demonstrate remarkable performance across a range of tasks, including the problem of left-ventricular ejection fraction regression and the diagnosis of 39 different conditions such as cardiac amyloidosis and hypertrophic cardiomyopathy. We show that our deep-learning system is capable of not only contextualizing the staggering complexity of human cardiovascular disease but can be directed towards clinical problems of interest, yielding impressive, clinical-grade diagnostic accuracy with a fraction of the training data typically required for such tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2312_00357
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A Generalizable Deep Learning System for Cardiac MRI
Shad, Rohan
Zakka, Cyril
Kaur, Dhamanpreet
Mathur, Mrudang
Fong, Robyn
Cho, Joseph
Filice, Ross Warren
Mongan, John
Kalianos, Kimberly
Khandwala, Nishith
Eng, David
Leipzig, Matthew
Witschey, Walter R.
de Feria, Alejandro
Ferrari, Victor A.
Ashley, Euan A.
Acker, Michael A.
Langlotz, Curtis
Hiesinger, William
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
I.2.10
Cardiac MRI allows for a comprehensive assessment of myocardial structure, function and tissue characteristics. Here we describe a foundational vision system for cardiac MRI, capable of representing the breadth of human cardiovascular disease and health. Our deep-learning model is trained via self-supervised contrastive learning, in which visual concepts in cine-sequence cardiac MRI scans are learned from the raw text of the accompanying radiology reports. We train and evaluate our model on data from four large academic clinical institutions in the United States. We additionally showcase the performance of our models on the UK BioBank and two additional publicly available external datasets. We explore emergent capabilities of our system and demonstrate remarkable performance across a range of tasks, including the problem of left-ventricular ejection fraction regression and the diagnosis of 39 different conditions such as cardiac amyloidosis and hypertrophic cardiomyopathy. We show that our deep-learning system is capable of not only contextualizing the staggering complexity of human cardiovascular disease but can be directed towards clinical problems of interest, yielding impressive, clinical-grade diagnostic accuracy with a fraction of the training data typically required for such tasks.
title A Generalizable Deep Learning System for Cardiac MRI
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
I.2.10
url https://arxiv.org/abs/2312.00357