Saved in:
Bibliographic Details
Main Authors: Luo, Xinzhe, Wang, Xin, Shapiro, Linda, Yuan, Chun, Feng, Jianfeng, Zhuang, Xiahai
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.02141
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916947949518848
author Luo, Xinzhe
Wang, Xin
Shapiro, Linda
Yuan, Chun
Feng, Jianfeng
Zhuang, Xiahai
author_facet Luo, Xinzhe
Wang, Xin
Shapiro, Linda
Yuan, Chun
Feng, Jianfeng
Zhuang, Xiahai
contents This article presents a general Bayesian learning framework for multi-modal groupwise image registration. The method builds on probabilistic modelling of the image generative process, where the underlying common anatomy and geometric variations of the observed images are explicitly disentangled as latent variables. Therefore, groupwise image registration is achieved via hierarchical Bayesian inference. We propose a novel hierarchical variational auto-encoding architecture to realise the inference procedure of the latent variables, where the registration parameters can be explicitly estimated in a mathematically interpretable fashion. Remarkably, this new paradigm learns groupwise image registration in an unsupervised closed-loop self-reconstruction process, sparing the burden of designing complex image-based similarity measures. The computationally efficient disentangled network architecture is also inherently scalable and flexible, allowing for groupwise registration on large-scale image groups with variable sizes. Furthermore, the inferred structural representations from multi-modal images via disentanglement learning are capable of capturing the latent anatomy of the observations with visual semantics. Extensive experiments were conducted to validate the proposed framework, including four different datasets from cardiac, brain, and abdominal medical images. The results have demonstrated the superiority of our method over conventional similarity-based approaches in terms of accuracy, efficiency, scalability, and interpretability.
format Preprint
id arxiv_https___arxiv_org_abs_2401_02141
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Bayesian Unsupervised Disentanglement of Anatomy and Geometry for Deep Groupwise Image Registration
Luo, Xinzhe
Wang, Xin
Shapiro, Linda
Yuan, Chun
Feng, Jianfeng
Zhuang, Xiahai
Computer Vision and Pattern Recognition
This article presents a general Bayesian learning framework for multi-modal groupwise image registration. The method builds on probabilistic modelling of the image generative process, where the underlying common anatomy and geometric variations of the observed images are explicitly disentangled as latent variables. Therefore, groupwise image registration is achieved via hierarchical Bayesian inference. We propose a novel hierarchical variational auto-encoding architecture to realise the inference procedure of the latent variables, where the registration parameters can be explicitly estimated in a mathematically interpretable fashion. Remarkably, this new paradigm learns groupwise image registration in an unsupervised closed-loop self-reconstruction process, sparing the burden of designing complex image-based similarity measures. The computationally efficient disentangled network architecture is also inherently scalable and flexible, allowing for groupwise registration on large-scale image groups with variable sizes. Furthermore, the inferred structural representations from multi-modal images via disentanglement learning are capable of capturing the latent anatomy of the observations with visual semantics. Extensive experiments were conducted to validate the proposed framework, including four different datasets from cardiac, brain, and abdominal medical images. The results have demonstrated the superiority of our method over conventional similarity-based approaches in terms of accuracy, efficiency, scalability, and interpretability.
title Bayesian Unsupervised Disentanglement of Anatomy and Geometry for Deep Groupwise Image Registration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2401.02141