MR2US-Pro: Prostate MR to Ultrasound Image Translation and Registration Based on Diffusion Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ma, Xudong, Anantrasirichai, Nantheera, Bolomytis, Stefanos, Achim, Alin
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915318471852032
author Ma, Xudong
Anantrasirichai, Nantheera
Bolomytis, Stefanos
Achim, Alin
author_facet Ma, Xudong
Anantrasirichai, Nantheera
Bolomytis, Stefanos
Achim, Alin
contents The diagnosis of prostate cancer increasingly depends on multimodal imaging, particularly magnetic resonance imaging (MRI) and transrectal ultrasound (TRUS). However, accurate registration between these modalities remains a fundamental challenge due to the differences in dimensionality and anatomical representations. In this work, we present a novel framework that addresses these challenges through a two-stage process: TRUS 3D reconstruction followed by cross-modal registration. Unlike existing TRUS 3D reconstruction methods that rely heavily on external probe tracking information, we propose a totally probe-location-independent approach that leverages the natural correlation between sagittal and transverse TRUS views. With the help of our clustering-based feature matching method, we enable the spatial localization of 2D frames without any additional probe tracking information. For the registration stage, we introduce an unsupervised diffusion-based framework guided by modality translation. Unlike existing methods that translate one modality into another, we map both MR and US into a pseudo intermediate modality. This design enables us to customize it to retain only registration-critical features, greatly easing registration. To further enhance anatomical alignment, we incorporate an anatomy-aware registration strategy that prioritizes internal structural coherence while adaptively reducing the influence of boundary inconsistencies. Extensive validation demonstrates that our approach outperforms state-of-the-art methods by achieving superior registration accuracy with physically realistic deformations in a completely unsupervised fashion.
format Preprint
id arxiv_https___arxiv_org_abs_2506_00591
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MR2US-Pro: Prostate MR to Ultrasound Image Translation and Registration Based on Diffusion Models
Ma, Xudong
Anantrasirichai, Nantheera
Bolomytis, Stefanos
Achim, Alin
Image and Video Processing
Computer Vision and Pattern Recognition
The diagnosis of prostate cancer increasingly depends on multimodal imaging, particularly magnetic resonance imaging (MRI) and transrectal ultrasound (TRUS). However, accurate registration between these modalities remains a fundamental challenge due to the differences in dimensionality and anatomical representations. In this work, we present a novel framework that addresses these challenges through a two-stage process: TRUS 3D reconstruction followed by cross-modal registration. Unlike existing TRUS 3D reconstruction methods that rely heavily on external probe tracking information, we propose a totally probe-location-independent approach that leverages the natural correlation between sagittal and transverse TRUS views. With the help of our clustering-based feature matching method, we enable the spatial localization of 2D frames without any additional probe tracking information. For the registration stage, we introduce an unsupervised diffusion-based framework guided by modality translation. Unlike existing methods that translate one modality into another, we map both MR and US into a pseudo intermediate modality. This design enables us to customize it to retain only registration-critical features, greatly easing registration. To further enhance anatomical alignment, we incorporate an anatomy-aware registration strategy that prioritizes internal structural coherence while adaptively reducing the influence of boundary inconsistencies. Extensive validation demonstrates that our approach outperforms state-of-the-art methods by achieving superior registration accuracy with physically realistic deformations in a completely unsupervised fashion.
title MR2US-Pro: Prostate MR to Ultrasound Image Translation and Registration Based on Diffusion Models
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.00591