Interactive Holographic Visualization for 3D Facial Avatar

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Nguyen, Tri Tung Nguyen, Yasuyuki, Fujii, Tran, Dinh Tuan, Lee, Joo-Ho
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929711666429952
author Nguyen, Tri Tung Nguyen
Yasuyuki, Fujii
Tran, Dinh Tuan
Lee, Joo-Ho
author_facet Nguyen, Tri Tung Nguyen
Yasuyuki, Fujii
Tran, Dinh Tuan
Lee, Joo-Ho
contents Traditional methods for visualizing dynamic human expressions, particularly in medical training, often rely on flat-screen displays or static mannequins, which have proven inefficient for realistic simulation. In response, we propose a platform that leverages a 3D interactive facial avatar capable of displaying non-verbal feedback, including pain signals. This avatar is projected onto a stereoscopic, view-dependent 3D display, offering a more immersive and realistic simulated patient experience for pain assessment practice. However, there is no existing solution that dynamically predicts and projects interactive 3D facial avatars in real-time. To overcome this, we emphasize the need for a 3D display projection system that can project the facial avatar holographically, allowing users to interact with the avatar from any viewpoint. By incorporating 3D Gaussian Splatting (3DGS) and real-time view-dependent calibration, we significantly improve the training environment for accurate pain recognition and assessment.
format Preprint
id arxiv_https___arxiv_org_abs_2502_08085
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Interactive Holographic Visualization for 3D Facial Avatar
Nguyen, Tri Tung Nguyen
Yasuyuki, Fujii
Tran, Dinh Tuan
Lee, Joo-Ho
Graphics
Traditional methods for visualizing dynamic human expressions, particularly in medical training, often rely on flat-screen displays or static mannequins, which have proven inefficient for realistic simulation. In response, we propose a platform that leverages a 3D interactive facial avatar capable of displaying non-verbal feedback, including pain signals. This avatar is projected onto a stereoscopic, view-dependent 3D display, offering a more immersive and realistic simulated patient experience for pain assessment practice. However, there is no existing solution that dynamically predicts and projects interactive 3D facial avatars in real-time. To overcome this, we emphasize the need for a 3D display projection system that can project the facial avatar holographically, allowing users to interact with the avatar from any viewpoint. By incorporating 3D Gaussian Splatting (3DGS) and real-time view-dependent calibration, we significantly improve the training environment for accurate pain recognition and assessment.
title Interactive Holographic Visualization for 3D Facial Avatar
topic Graphics
url https://arxiv.org/abs/2502.08085