Echocardiography to Cardiac MRI View Transformation for Real-Time Blind Restoration

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Adalioglu, Ilke, Kiranyaz, Serkan, Ahishali, Mete, Degerli, Aysen, Hamid, Tahir, Ghaffar, Rahmat, Hamila, Ridha, Gabbouj, Moncef
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909421113704448
author Adalioglu, Ilke
Kiranyaz, Serkan
Ahishali, Mete
Degerli, Aysen
Hamid, Tahir
Ghaffar, Rahmat
Hamila, Ridha
Gabbouj, Moncef
author_facet Adalioglu, Ilke
Kiranyaz, Serkan
Ahishali, Mete
Degerli, Aysen
Hamid, Tahir
Ghaffar, Rahmat
Hamila, Ridha
Gabbouj, Moncef
contents Echocardiography is the most widely used imaging to monitor cardiac functions, serving as the first line in early detection of myocardial ischemia and infarction. However, echocardiography often suffers from several artifacts including sensor noise, lack of contrast, severe saturation, and missing myocardial segments which severely limit its usage in clinical diagnosis. In recent years, several machine learning methods have been proposed to improve echocardiography views. Yet, these methods usually address only a specific problem (e.g. denoising) and thus cannot provide a robust and reliable restoration in general. On the other hand, cardiac MRI provides a clean view of the heart without suffering such severe issues. However, due to its significantly higher cost, it is often only afforded by a few major hospitals, hence hindering its use and accessibility. In this pilot study, we propose a novel approach to transform echocardiography into the cardiac MRI view. For this purpose, Echo2MRI dataset, consisting of echocardiography and real cardiac MRI image pairs, is composed and will be shared publicly. A dedicated Cycle-consistent Generative Adversarial Network (Cycle-GAN) is trained to learn the transformation from echocardiography frames to cardiac MRI views. An extensive set of qualitative evaluations shows that the proposed transformer can synthesize high-quality artifact-free synthetic cardiac MRI views from a given sequence of echocardiography frames. Medical evaluations performed by a group of cardiologists further demonstrate that synthetic MRI views are indistinguishable from their original counterparts and are preferred over their initial sequence of echocardiography frames for diagnosis in 78.9% of the cases.
format Preprint
id arxiv_https___arxiv_org_abs_2412_06445
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Echocardiography to Cardiac MRI View Transformation for Real-Time Blind Restoration
Adalioglu, Ilke
Kiranyaz, Serkan
Ahishali, Mete
Degerli, Aysen
Hamid, Tahir
Ghaffar, Rahmat
Hamila, Ridha
Gabbouj, Moncef
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
Echocardiography is the most widely used imaging to monitor cardiac functions, serving as the first line in early detection of myocardial ischemia and infarction. However, echocardiography often suffers from several artifacts including sensor noise, lack of contrast, severe saturation, and missing myocardial segments which severely limit its usage in clinical diagnosis. In recent years, several machine learning methods have been proposed to improve echocardiography views. Yet, these methods usually address only a specific problem (e.g. denoising) and thus cannot provide a robust and reliable restoration in general. On the other hand, cardiac MRI provides a clean view of the heart without suffering such severe issues. However, due to its significantly higher cost, it is often only afforded by a few major hospitals, hence hindering its use and accessibility. In this pilot study, we propose a novel approach to transform echocardiography into the cardiac MRI view. For this purpose, Echo2MRI dataset, consisting of echocardiography and real cardiac MRI image pairs, is composed and will be shared publicly. A dedicated Cycle-consistent Generative Adversarial Network (Cycle-GAN) is trained to learn the transformation from echocardiography frames to cardiac MRI views. An extensive set of qualitative evaluations shows that the proposed transformer can synthesize high-quality artifact-free synthetic cardiac MRI views from a given sequence of echocardiography frames. Medical evaluations performed by a group of cardiologists further demonstrate that synthetic MRI views are indistinguishable from their original counterparts and are preferred over their initial sequence of echocardiography frames for diagnosis in 78.9% of the cases.
title Echocardiography to Cardiac MRI View Transformation for Real-Time Blind Restoration
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2412.06445