Feasibility Study of a Diffusion-Based Model for Cross-Modal Generation of Knee MRI from X-ray: Integrating Radiographic Feature Information

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wang, Zhe, Chen, Yung Hsin, Chetouani, Aladine, Bauer, Fabian, Ru, Yuhua, Chen, Fang, Zhang, Liping, Jennane, Rachid, Jarraya, Mohamed
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912169728147456
author Wang, Zhe
Chen, Yung Hsin
Chetouani, Aladine
Bauer, Fabian
Ru, Yuhua
Chen, Fang
Zhang, Liping
Jennane, Rachid
Jarraya, Mohamed
author_facet Wang, Zhe
Chen, Yung Hsin
Chetouani, Aladine
Bauer, Fabian
Ru, Yuhua
Chen, Fang
Zhang, Liping
Jennane, Rachid
Jarraya, Mohamed
contents Knee osteoarthritis (KOA) is a prevalent musculoskeletal disorder, often diagnosed using X-rays due to its cost-effectiveness. While Magnetic Resonance Imaging (MRI) provides superior soft tissue visualization and serves as a valuable supplementary diagnostic tool, its high cost and limited accessibility significantly restrict its widespread use. To explore the feasibility of bridging this imaging gap, we conducted a feasibility study leveraging a diffusion-based model that uses an X-ray image as conditional input, alongside target depth and additional patient-specific feature information, to generate corresponding MRI sequences. Our findings demonstrate that the MRI volumes generated by our approach is visually closer to real MRI scans. Moreover, increasing inference steps enhances the continuity and smoothness of the synthesized MRI sequences. Through ablation studies, we further validate that integrating supplementary patient-specific information, beyond what X-rays alone can provide, enhances the accuracy and clinical relevance of the generated MRI, which underscores the potential of leveraging external patient-specific information to improve the MRI generation. This study is available at https://zwang78.github.io/.
format Preprint
id arxiv_https___arxiv_org_abs_2410_06997
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Feasibility Study of a Diffusion-Based Model for Cross-Modal Generation of Knee MRI from X-ray: Integrating Radiographic Feature Information
Wang, Zhe
Chen, Yung Hsin
Chetouani, Aladine
Bauer, Fabian
Ru, Yuhua
Chen, Fang
Zhang, Liping
Jennane, Rachid
Jarraya, Mohamed
Image and Video Processing
Computer Vision and Pattern Recognition
Knee osteoarthritis (KOA) is a prevalent musculoskeletal disorder, often diagnosed using X-rays due to its cost-effectiveness. While Magnetic Resonance Imaging (MRI) provides superior soft tissue visualization and serves as a valuable supplementary diagnostic tool, its high cost and limited accessibility significantly restrict its widespread use. To explore the feasibility of bridging this imaging gap, we conducted a feasibility study leveraging a diffusion-based model that uses an X-ray image as conditional input, alongside target depth and additional patient-specific feature information, to generate corresponding MRI sequences. Our findings demonstrate that the MRI volumes generated by our approach is visually closer to real MRI scans. Moreover, increasing inference steps enhances the continuity and smoothness of the synthesized MRI sequences. Through ablation studies, we further validate that integrating supplementary patient-specific information, beyond what X-rays alone can provide, enhances the accuracy and clinical relevance of the generated MRI, which underscores the potential of leveraging external patient-specific information to improve the MRI generation. This study is available at https://zwang78.github.io/.
title Feasibility Study of a Diffusion-Based Model for Cross-Modal Generation of Knee MRI from X-ray: Integrating Radiographic Feature Information
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.06997