Saved in:
Bibliographic Details
Main Authors: Li, Pengfei, Ma, Ziyue, Wang, Hong, Deng, Juan, Wang, Yan, Xu, Zhenyu, Yan, Feng, Tu, Wenjun, Sha, Hong
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.14292
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910457704480768
author Li, Pengfei
Ma, Ziyue
Wang, Hong
Deng, Juan
Wang, Yan
Xu, Zhenyu
Yan, Feng
Tu, Wenjun
Sha, Hong
author_facet Li, Pengfei
Ma, Ziyue
Wang, Hong
Deng, Juan
Wang, Yan
Xu, Zhenyu
Yan, Feng
Tu, Wenjun
Sha, Hong
contents Background and Objective: In neurosurgery, fusing clinical images and depth images that can improve the information and details is beneficial to surgery. We found that the registration of face depth images was invalid frequently using existing methods. To abundant traditional image methods with depth information, a method in registering with depth images and traditional clinical images was investigated. Methods: We used the dlib library, a C++ library that could be used in face recognition, and recognized the key points on faces from the structure light camera and CT image. The two key point clouds were registered for coarse registration by the ICP method. Fine registration was finished after coarse registration by the ICP method. Results: RMSE after coarse and fine registration is as low as 0.995913 mm. Compared with traditional methods, it also takes less time. Conclusions: The new method successfully registered the facial depth image from structure light images and CT with a low error, and that would be promising and efficient in clinical application of neurosurgery.
format Preprint
id arxiv_https___arxiv_org_abs_2405_14292
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A New Method in Facial Registration in Clinics Based on Structure Light Images
Li, Pengfei
Ma, Ziyue
Wang, Hong
Deng, Juan
Wang, Yan
Xu, Zhenyu
Yan, Feng
Tu, Wenjun
Sha, Hong
Computer Vision and Pattern Recognition
Robotics
Background and Objective: In neurosurgery, fusing clinical images and depth images that can improve the information and details is beneficial to surgery. We found that the registration of face depth images was invalid frequently using existing methods. To abundant traditional image methods with depth information, a method in registering with depth images and traditional clinical images was investigated. Methods: We used the dlib library, a C++ library that could be used in face recognition, and recognized the key points on faces from the structure light camera and CT image. The two key point clouds were registered for coarse registration by the ICP method. Fine registration was finished after coarse registration by the ICP method. Results: RMSE after coarse and fine registration is as low as 0.995913 mm. Compared with traditional methods, it also takes less time. Conclusions: The new method successfully registered the facial depth image from structure light images and CT with a low error, and that would be promising and efficient in clinical application of neurosurgery.
title A New Method in Facial Registration in Clinics Based on Structure Light Images
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2405.14292