Leveraging Diffusion Model and Image Foundation Model for Improved Correspondence Matching in Coronary Angiography

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhao, Lin, Yu, Xin, Liu, Yikang, Chen, Xiao, Chen, Eric Z., Chen, Terrence, Sun, Shanhui
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916668408594432
author Zhao, Lin
Yu, Xin
Liu, Yikang
Chen, Xiao
Chen, Eric Z.
Chen, Terrence
Sun, Shanhui
author_facet Zhao, Lin
Yu, Xin
Liu, Yikang
Chen, Xiao
Chen, Eric Z.
Chen, Terrence
Sun, Shanhui
contents Accurate correspondence matching in coronary angiography images is crucial for reconstructing 3D coronary artery structures, which is essential for precise diagnosis and treatment planning of coronary artery disease (CAD). Traditional matching methods for natural images often fail to generalize to X-ray images due to inherent differences such as lack of texture, lower contrast, and overlapping structures, compounded by insufficient training data. To address these challenges, we propose a novel pipeline that generates realistic paired coronary angiography images using a diffusion model conditioned on 2D projections of 3D reconstructed meshes from Coronary Computed Tomography Angiography (CCTA), providing high-quality synthetic data for training. Additionally, we employ large-scale image foundation models to guide feature aggregation, enhancing correspondence matching accuracy by focusing on semantically relevant regions and keypoints. Our approach demonstrates superior matching performance on synthetic datasets and effectively generalizes to real-world datasets, offering a practical solution for this task. Furthermore, our work investigates the efficacy of different foundation models in correspondence matching, providing novel insights into leveraging advanced image foundation models for medical imaging applications.
format Preprint
id arxiv_https___arxiv_org_abs_2504_00191
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Leveraging Diffusion Model and Image Foundation Model for Improved Correspondence Matching in Coronary Angiography
Zhao, Lin
Yu, Xin
Liu, Yikang
Chen, Xiao
Chen, Eric Z.
Chen, Terrence
Sun, Shanhui
Computer Vision and Pattern Recognition
Accurate correspondence matching in coronary angiography images is crucial for reconstructing 3D coronary artery structures, which is essential for precise diagnosis and treatment planning of coronary artery disease (CAD). Traditional matching methods for natural images often fail to generalize to X-ray images due to inherent differences such as lack of texture, lower contrast, and overlapping structures, compounded by insufficient training data. To address these challenges, we propose a novel pipeline that generates realistic paired coronary angiography images using a diffusion model conditioned on 2D projections of 3D reconstructed meshes from Coronary Computed Tomography Angiography (CCTA), providing high-quality synthetic data for training. Additionally, we employ large-scale image foundation models to guide feature aggregation, enhancing correspondence matching accuracy by focusing on semantically relevant regions and keypoints. Our approach demonstrates superior matching performance on synthetic datasets and effectively generalizes to real-world datasets, offering a practical solution for this task. Furthermore, our work investigates the efficacy of different foundation models in correspondence matching, providing novel insights into leveraging advanced image foundation models for medical imaging applications.
title Leveraging Diffusion Model and Image Foundation Model for Improved Correspondence Matching in Coronary Angiography
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.00191