Facial Surgery Preview Based on the Orthognathic Treatment Prediction

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Han, Huijun, Zhang, Congyi, Zhu, Lifeng, Singh, Pradeep, Hsung, Richard Tai Chiu, Leung, Yiu Yan, Komura, Taku, Wang, Wenping, Gu, Min
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915242493083648
author Han, Huijun
Zhang, Congyi
Zhu, Lifeng
Singh, Pradeep
Hsung, Richard Tai Chiu
Leung, Yiu Yan
Komura, Taku
Wang, Wenping
Gu, Min
author_facet Han, Huijun
Zhang, Congyi
Zhu, Lifeng
Singh, Pradeep
Hsung, Richard Tai Chiu
Leung, Yiu Yan
Komura, Taku
Wang, Wenping
Gu, Min
contents Orthognathic surgery consultation is essential to help patients understand the changes to their facial appearance after surgery. However, current visualization methods are often inefficient and inaccurate due to limited pre- and post-treatment data and the complexity of the treatment. To overcome these challenges, this study aims to develop a fully automated pipeline that generates accurate and efficient 3D previews of postsurgical facial appearances for patients with orthognathic treatment without requiring additional medical images. The study introduces novel aesthetic losses, such as mouth-convexity and asymmetry losses, to improve the accuracy of facial surgery prediction. Additionally, it proposes a specialized parametric model for 3D reconstruction of the patient, medical-related losses to guide latent code prediction network optimization, and a data augmentation scheme to address insufficient data. The study additionally employs FLAME, a parametric model, to enhance the quality of facial appearance previews by extracting facial latent codes and establishing dense correspondences between pre- and post-surgery geometries. Quantitative comparisons showed the algorithm's effectiveness, and qualitative results highlighted accurate facial contour and detail predictions. A user study confirmed that doctors and the public could not distinguish between machine learning predictions and actual postoperative results. This study aims to offer a practical, effective solution for orthognathic surgery consultations, benefiting doctors and patients.
format Preprint
id arxiv_https___arxiv_org_abs_2412_11045
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Facial Surgery Preview Based on the Orthognathic Treatment Prediction
Han, Huijun
Zhang, Congyi
Zhu, Lifeng
Singh, Pradeep
Hsung, Richard Tai Chiu
Leung, Yiu Yan
Komura, Taku
Wang, Wenping
Gu, Min
Computer Vision and Pattern Recognition
Human-Computer Interaction
68U99
Orthognathic surgery consultation is essential to help patients understand the changes to their facial appearance after surgery. However, current visualization methods are often inefficient and inaccurate due to limited pre- and post-treatment data and the complexity of the treatment. To overcome these challenges, this study aims to develop a fully automated pipeline that generates accurate and efficient 3D previews of postsurgical facial appearances for patients with orthognathic treatment without requiring additional medical images. The study introduces novel aesthetic losses, such as mouth-convexity and asymmetry losses, to improve the accuracy of facial surgery prediction. Additionally, it proposes a specialized parametric model for 3D reconstruction of the patient, medical-related losses to guide latent code prediction network optimization, and a data augmentation scheme to address insufficient data. The study additionally employs FLAME, a parametric model, to enhance the quality of facial appearance previews by extracting facial latent codes and establishing dense correspondences between pre- and post-surgery geometries. Quantitative comparisons showed the algorithm's effectiveness, and qualitative results highlighted accurate facial contour and detail predictions. A user study confirmed that doctors and the public could not distinguish between machine learning predictions and actual postoperative results. This study aims to offer a practical, effective solution for orthognathic surgery consultations, benefiting doctors and patients.
title Facial Surgery Preview Based on the Orthognathic Treatment Prediction
topic Computer Vision and Pattern Recognition
Human-Computer Interaction
68U99
url https://arxiv.org/abs/2412.11045