World of Forms: Deformable Geometric Templates for One-Shot Surface Meshing in Coronary CT Angiography

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: van Herten, Rudolf L. M., Lagogiannis, Ioannis, Wolterink, Jelmer M., Bruns, Steffen, Meulendijks, Eva R., Dey, Damini, de Groot, Joris R., Henriques, José P., Planken, R. Nils, Saitta, Simone, Išgum, Ivana
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910838588178432
author van Herten, Rudolf L. M.
Lagogiannis, Ioannis
Wolterink, Jelmer M.
Bruns, Steffen
Meulendijks, Eva R.
Dey, Damini
de Groot, Joris R.
Henriques, José P.
Planken, R. Nils
Saitta, Simone
Išgum, Ivana
author_facet van Herten, Rudolf L. M.
Lagogiannis, Ioannis
Wolterink, Jelmer M.
Bruns, Steffen
Meulendijks, Eva R.
Dey, Damini
de Groot, Joris R.
Henriques, José P.
Planken, R. Nils
Saitta, Simone
Išgum, Ivana
contents Deep learning-based medical image segmentation and surface mesh generation typically involve a sequential pipeline from image to segmentation to meshes, often requiring large training datasets while making limited use of prior geometric knowledge. This may lead to topological inconsistencies and suboptimal performance in low-data regimes. To address these challenges, we propose a data-efficient deep learning method for direct 3D anatomical object surface meshing using geometric priors. Our approach employs a multi-resolution graph neural network that operates on a prior geometric template which is deformed to fit object boundaries of interest. We show how different templates may be used for the different surface meshing targets, and introduce a novel masked autoencoder pretraining strategy for 3D spherical data. The proposed method outperforms nnUNet in a one-shot setting for segmentation of the pericardium, left ventricle (LV) cavity and the LV myocardium. Similarly, the method outperforms other lumen segmentation operating on multi-planar reformatted images. Results further indicate that mesh quality is on par with or improves upon marching cubes post-processing of voxel mask predictions, while remaining flexible in the choice of mesh triangulation prior, thus paving the way for more accurate and topologically consistent 3D medical object surface meshing.
format Preprint
id arxiv_https___arxiv_org_abs_2409_11837
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle World of Forms: Deformable Geometric Templates for One-Shot Surface Meshing in Coronary CT Angiography
van Herten, Rudolf L. M.
Lagogiannis, Ioannis
Wolterink, Jelmer M.
Bruns, Steffen
Meulendijks, Eva R.
Dey, Damini
de Groot, Joris R.
Henriques, José P.
Planken, R. Nils
Saitta, Simone
Išgum, Ivana
Image and Video Processing
Deep learning-based medical image segmentation and surface mesh generation typically involve a sequential pipeline from image to segmentation to meshes, often requiring large training datasets while making limited use of prior geometric knowledge. This may lead to topological inconsistencies and suboptimal performance in low-data regimes. To address these challenges, we propose a data-efficient deep learning method for direct 3D anatomical object surface meshing using geometric priors. Our approach employs a multi-resolution graph neural network that operates on a prior geometric template which is deformed to fit object boundaries of interest. We show how different templates may be used for the different surface meshing targets, and introduce a novel masked autoencoder pretraining strategy for 3D spherical data. The proposed method outperforms nnUNet in a one-shot setting for segmentation of the pericardium, left ventricle (LV) cavity and the LV myocardium. Similarly, the method outperforms other lumen segmentation operating on multi-planar reformatted images. Results further indicate that mesh quality is on par with or improves upon marching cubes post-processing of voxel mask predictions, while remaining flexible in the choice of mesh triangulation prior, thus paving the way for more accurate and topologically consistent 3D medical object surface meshing.
title World of Forms: Deformable Geometric Templates for One-Shot Surface Meshing in Coronary CT Angiography
topic Image and Video Processing
url https://arxiv.org/abs/2409.11837