Translating Electrocardiograms to Cardiac Magnetic Resonance Imaging Useful for Cardiac Assessment and Disease Screening: A Multi-Center Study

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ding, Zhengyao, Li, Ziyu, Hu, Yujian, Xu, Youyao, Zhao, Chengchen, Mao, Yiheng, Li, Haitao, Li, Zhikang, Li, Qian, Wang, Jing, Chen, Yue, Chen, Mengjia, Wang, Longbo, Chu, Xuesen, Pan, Weichao, Liu, Ziyi, Wu, Fei, Zhang, Hongkun, Chen, Ting, Huang, Zhengxing
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917147858436096
author Ding, Zhengyao
Li, Ziyu
Hu, Yujian
Xu, Youyao
Zhao, Chengchen
Mao, Yiheng
Li, Haitao
Li, Zhikang
Li, Qian
Wang, Jing
Chen, Yue
Chen, Mengjia
Wang, Longbo
Chu, Xuesen
Pan, Weichao
Liu, Ziyi
Wu, Fei
Zhang, Hongkun
Chen, Ting
Huang, Zhengxing
author_facet Ding, Zhengyao
Li, Ziyu
Hu, Yujian
Xu, Youyao
Zhao, Chengchen
Mao, Yiheng
Li, Haitao
Li, Zhikang
Li, Qian
Wang, Jing
Chen, Yue
Chen, Mengjia
Wang, Longbo
Chu, Xuesen
Pan, Weichao
Liu, Ziyi
Wu, Fei
Zhang, Hongkun
Chen, Ting
Huang, Zhengxing
contents Cardiovascular diseases (CVDs) are the leading cause of global mortality, necessitating accessible and accurate diagnostic tools. While cardiac magnetic resonance imaging (CMR) provides gold-standard insights into cardiac structure and function, its clinical utility is limited by high cost and complexity. In contrast, electrocardiography (ECG) is inexpensive and widely available but lacks the granularity of CMR. We propose CardioNets, a deep learning framework that translates 12-lead ECG signals into CMR-level functional parameters and synthetic images, enabling scalable cardiac assessment. CardioNets integrates cross-modal contrastive learning and generative pretraining, aligning ECG with CMR-derived cardiac phenotypes and synthesizing high-resolution CMR images via a masked autoregressive model. Trained on 159,819 samples from five cohorts, including the UK Biobank (n=42,483) and MIMIC-IV-ECG (n=164,550), and externally validated on independent clinical datasets (n=3,767), CardioNets achieved strong performance across disease screening and phenotype estimation tasks. In the UK Biobank, it improved cardiac phenotype regression R2 by 24.8% and cardiomyopathy AUC by up to 39.3% over baseline models. In MIMIC, it increased AUC for pulmonary hypertension detection by 5.6%. Generated CMR images showed 36.6% higher SSIM and 8.7% higher PSNR than prior approaches. In a reader study, ECG-only CardioNets achieved 13.9% higher accuracy than human physicians using both ECG and real CMR. These results suggest that CardioNets offers a promising, low-cost alternative to CMR for large-scale CVD screening, particularly in resource-limited settings. Future efforts will focus on clinical deployment and regulatory validation of ECG-based synthetic imaging.
format Preprint
id arxiv_https___arxiv_org_abs_2411_13602
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Translating Electrocardiograms to Cardiac Magnetic Resonance Imaging Useful for Cardiac Assessment and Disease Screening: A Multi-Center Study
Ding, Zhengyao
Li, Ziyu
Hu, Yujian
Xu, Youyao
Zhao, Chengchen
Mao, Yiheng
Li, Haitao
Li, Zhikang
Li, Qian
Wang, Jing
Chen, Yue
Chen, Mengjia
Wang, Longbo
Chu, Xuesen
Pan, Weichao
Liu, Ziyi
Wu, Fei
Zhang, Hongkun
Chen, Ting
Huang, Zhengxing
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Cardiovascular diseases (CVDs) are the leading cause of global mortality, necessitating accessible and accurate diagnostic tools. While cardiac magnetic resonance imaging (CMR) provides gold-standard insights into cardiac structure and function, its clinical utility is limited by high cost and complexity. In contrast, electrocardiography (ECG) is inexpensive and widely available but lacks the granularity of CMR. We propose CardioNets, a deep learning framework that translates 12-lead ECG signals into CMR-level functional parameters and synthetic images, enabling scalable cardiac assessment. CardioNets integrates cross-modal contrastive learning and generative pretraining, aligning ECG with CMR-derived cardiac phenotypes and synthesizing high-resolution CMR images via a masked autoregressive model. Trained on 159,819 samples from five cohorts, including the UK Biobank (n=42,483) and MIMIC-IV-ECG (n=164,550), and externally validated on independent clinical datasets (n=3,767), CardioNets achieved strong performance across disease screening and phenotype estimation tasks. In the UK Biobank, it improved cardiac phenotype regression R2 by 24.8% and cardiomyopathy AUC by up to 39.3% over baseline models. In MIMIC, it increased AUC for pulmonary hypertension detection by 5.6%. Generated CMR images showed 36.6% higher SSIM and 8.7% higher PSNR than prior approaches. In a reader study, ECG-only CardioNets achieved 13.9% higher accuracy than human physicians using both ECG and real CMR. These results suggest that CardioNets offers a promising, low-cost alternative to CMR for large-scale CVD screening, particularly in resource-limited settings. Future efforts will focus on clinical deployment and regulatory validation of ECG-based synthetic imaging.
title Translating Electrocardiograms to Cardiac Magnetic Resonance Imaging Useful for Cardiac Assessment and Disease Screening: A Multi-Center Study
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.13602