Hierarchical Uncertainty Estimation for Learning-based Registration in Neuroimaging

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hu, Xiaoling, Gopinath, Karthik, Liu, Peirong, Hoffmann, Malte, Van Leemput, Koen, Puonti, Oula, Iglesias, Juan Eugenio
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913724859678720
author Hu, Xiaoling
Gopinath, Karthik
Liu, Peirong
Hoffmann, Malte
Van Leemput, Koen
Puonti, Oula
Iglesias, Juan Eugenio
author_facet Hu, Xiaoling
Gopinath, Karthik
Liu, Peirong
Hoffmann, Malte
Van Leemput, Koen
Puonti, Oula
Iglesias, Juan Eugenio
contents Over recent years, deep learning based image registration has achieved impressive accuracy in many domains, including medical imaging and, specifically, human neuroimaging with magnetic resonance imaging (MRI). However, the uncertainty estimation associated with these methods has been largely limited to the application of generic techniques (e.g., Monte Carlo dropout) that do not exploit the peculiarities of the problem domain, particularly spatial modeling. Here, we propose a principled way to propagate uncertainties (epistemic or aleatoric) estimated at the level of spatial location by these methods, to the level of global transformation models, and further to downstream tasks. Specifically, we justify the choice of a Gaussian distribution for the local uncertainty modeling, and then propose a framework where uncertainties spread across hierarchical levels, depending on the choice of transformation model. Experiments on publicly available data sets show that Monte Carlo dropout correlates very poorly with the reference registration error, whereas our uncertainty estimates correlate much better. Crucially, the results also show that uncertainty-aware fitting of transformations improves the registration accuracy of brain MRI scans. Finally, we illustrate how sampling from the posterior distribution of the transformations can be used to propagate uncertainties to downstream neuroimaging tasks. Code is available at: https://github.com/HuXiaoling/Regre4Regis.
format Preprint
id arxiv_https___arxiv_org_abs_2410_09299
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Hierarchical Uncertainty Estimation for Learning-based Registration in Neuroimaging
Hu, Xiaoling
Gopinath, Karthik
Liu, Peirong
Hoffmann, Malte
Van Leemput, Koen
Puonti, Oula
Iglesias, Juan Eugenio
Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
Over recent years, deep learning based image registration has achieved impressive accuracy in many domains, including medical imaging and, specifically, human neuroimaging with magnetic resonance imaging (MRI). However, the uncertainty estimation associated with these methods has been largely limited to the application of generic techniques (e.g., Monte Carlo dropout) that do not exploit the peculiarities of the problem domain, particularly spatial modeling. Here, we propose a principled way to propagate uncertainties (epistemic or aleatoric) estimated at the level of spatial location by these methods, to the level of global transformation models, and further to downstream tasks. Specifically, we justify the choice of a Gaussian distribution for the local uncertainty modeling, and then propose a framework where uncertainties spread across hierarchical levels, depending on the choice of transformation model. Experiments on publicly available data sets show that Monte Carlo dropout correlates very poorly with the reference registration error, whereas our uncertainty estimates correlate much better. Crucially, the results also show that uncertainty-aware fitting of transformations improves the registration accuracy of brain MRI scans. Finally, we illustrate how sampling from the posterior distribution of the transformations can be used to propagate uncertainties to downstream neuroimaging tasks. Code is available at: https://github.com/HuXiaoling/Regre4Regis.
title Hierarchical Uncertainty Estimation for Learning-based Registration in Neuroimaging
topic Computer Vision and Pattern Recognition
Machine Learning
Image and Video Processing
url https://arxiv.org/abs/2410.09299