An End-to-End Deep Learning Generative Framework for Refinable Shape Matching and Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kalaie, Soodeh, Bulpitt, Andy, Frangi, Alejandro F., Gooya, Ali
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910361810108416
author Kalaie, Soodeh
Bulpitt, Andy
Frangi, Alejandro F.
Gooya, Ali
author_facet Kalaie, Soodeh
Bulpitt, Andy
Frangi, Alejandro F.
Gooya, Ali
contents Generative modelling for shapes is a prerequisite for In-Silico Clinical Trials (ISCTs), which aim to cost-effectively validate medical device interventions using synthetic anatomical shapes, often represented as 3D surface meshes. However, constructing AI models to generate shapes closely resembling the real mesh samples is challenging due to variable vertex counts, connectivities, and the lack of dense vertex-wise correspondences across the training data. Employing graph representations for meshes, we develop a novel unsupervised geometric deep-learning model to establish refinable shape correspondences in a latent space, construct a population-derived atlas and generate realistic synthetic shapes. We additionally extend our proposed base model to a joint shape generative-clustering multi-atlas framework to incorporate further variability and preserve more details in the generated shapes. Experimental results using liver and left-ventricular models demonstrate the approach's applicability to computational medicine, highlighting its suitability for ISCTs through a comparative analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2403_06317
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle An End-to-End Deep Learning Generative Framework for Refinable Shape Matching and Generation
Kalaie, Soodeh
Bulpitt, Andy
Frangi, Alejandro F.
Gooya, Ali
Computer Vision and Pattern Recognition
Artificial Intelligence
Generative modelling for shapes is a prerequisite for In-Silico Clinical Trials (ISCTs), which aim to cost-effectively validate medical device interventions using synthetic anatomical shapes, often represented as 3D surface meshes. However, constructing AI models to generate shapes closely resembling the real mesh samples is challenging due to variable vertex counts, connectivities, and the lack of dense vertex-wise correspondences across the training data. Employing graph representations for meshes, we develop a novel unsupervised geometric deep-learning model to establish refinable shape correspondences in a latent space, construct a population-derived atlas and generate realistic synthetic shapes. We additionally extend our proposed base model to a joint shape generative-clustering multi-atlas framework to incorporate further variability and preserve more details in the generated shapes. Experimental results using liver and left-ventricular models demonstrate the approach's applicability to computational medicine, highlighting its suitability for ISCTs through a comparative analysis.
title An End-to-End Deep Learning Generative Framework for Refinable Shape Matching and Generation
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2403.06317