Three-Dimensional Anatomical Data Generation Based on Artificial Neural Networks

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Müller, Ann-Sophia, Jeong, Moonkwang, Zhang, Meng, Tian, Jiyuan, Miernik, Arkadiusz, Speidel, Stefanie, Qiu, Tian
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909921351565312
author Müller, Ann-Sophia
Jeong, Moonkwang
Zhang, Meng
Tian, Jiyuan
Miernik, Arkadiusz
Speidel, Stefanie
Qiu, Tian
author_facet Müller, Ann-Sophia
Jeong, Moonkwang
Zhang, Meng
Tian, Jiyuan
Miernik, Arkadiusz
Speidel, Stefanie
Qiu, Tian
contents Surgical planning and training based on machine learning requires a large amount of 3D anatomical models reconstructed from medical imaging, which is currently one of the major bottlenecks. Obtaining these data from real patients and during surgery is very demanding, if even possible, due to legal, ethical, and technical challenges. It is especially difficult for soft tissue organs with poor imaging contrast, such as the prostate. To overcome these challenges, we present a novel workflow for automated 3D anatomical data generation using data obtained from physical organ models. We additionally use a 3D Generative Adversarial Network (GAN) to obtain a manifold of 3D models useful for other downstream machine learning tasks that rely on 3D data. We demonstrate our workflow using an artificial prostate model made of biomimetic hydrogels with imaging contrast in multiple zones. This is used to physically simulate endoscopic surgery. For evaluation and 3D data generation, we place it into a customized ultrasound scanner that records the prostate before and after the procedure. A neural network is trained to segment the recorded ultrasound images, which outperforms conventional, non-learning-based computer vision techniques in terms of intersection over union (IoU). Based on the segmentations, a 3D mesh model is reconstructed, and performance feedback is provided.
format Preprint
id arxiv_https___arxiv_org_abs_2511_19198
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Three-Dimensional Anatomical Data Generation Based on Artificial Neural Networks
Müller, Ann-Sophia
Jeong, Moonkwang
Zhang, Meng
Tian, Jiyuan
Miernik, Arkadiusz
Speidel, Stefanie
Qiu, Tian
Computer Vision and Pattern Recognition
Robotics
Surgical planning and training based on machine learning requires a large amount of 3D anatomical models reconstructed from medical imaging, which is currently one of the major bottlenecks. Obtaining these data from real patients and during surgery is very demanding, if even possible, due to legal, ethical, and technical challenges. It is especially difficult for soft tissue organs with poor imaging contrast, such as the prostate. To overcome these challenges, we present a novel workflow for automated 3D anatomical data generation using data obtained from physical organ models. We additionally use a 3D Generative Adversarial Network (GAN) to obtain a manifold of 3D models useful for other downstream machine learning tasks that rely on 3D data. We demonstrate our workflow using an artificial prostate model made of biomimetic hydrogels with imaging contrast in multiple zones. This is used to physically simulate endoscopic surgery. For evaluation and 3D data generation, we place it into a customized ultrasound scanner that records the prostate before and after the procedure. A neural network is trained to segment the recorded ultrasound images, which outperforms conventional, non-learning-based computer vision techniques in terms of intersection over union (IoU). Based on the segmentations, a 3D mesh model is reconstructed, and performance feedback is provided.
title Three-Dimensional Anatomical Data Generation Based on Artificial Neural Networks
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2511.19198