Dense 3D Reconstruction Through Lidar: A Comparative Study on Ex-vivo Porcine Tissue

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Caccianiga, Guido, Nubert, Julian, Hutter, Marco, Kuchenbecker, Katherine J.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866907770679197696
author Caccianiga, Guido
Nubert, Julian
Hutter, Marco
Kuchenbecker, Katherine J.
author_facet Caccianiga, Guido
Nubert, Julian
Hutter, Marco
Kuchenbecker, Katherine J.
contents New sensing technologies and more advanced processing algorithms are transforming computer-integrated surgery. While researchers are actively investigating depth sensing and 3D reconstruction for vision-based surgical assistance, it remains difficult to achieve real-time, accurate, and robust 3D representations of the abdominal cavity for minimally invasive surgery. Thus, this work uses quantitative testing on fresh ex-vivo porcine tissue to thoroughly characterize the quality with which a 3D laser-based time-of-flight sensor (lidar) can perform anatomical surface reconstruction. Ground-truth surface shapes are captured with a commercial laser scanner, and the resulting signed error fields are analyzed using rigorous statistical tools. When compared to modern learning-based stereo matching from endoscopic images, time-of-flight sensing demonstrates higher precision, lower processing delay, higher frame rate, and superior robustness against sensor distance and poor illumination. Furthermore, we report on the potential negative effect of near-infrared light penetration on the accuracy of lidar measurements across different tissue samples, identifying a significant measured depth offset for muscle in contrast to fat and liver. Our findings highlight the potential of lidar for intraoperative 3D perception and point toward new methods that combine complementary time-of-flight and spectral imaging.
format Preprint
id arxiv_https___arxiv_org_abs_2401_10709
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Dense 3D Reconstruction Through Lidar: A Comparative Study on Ex-vivo Porcine Tissue
Caccianiga, Guido
Nubert, Julian
Hutter, Marco
Kuchenbecker, Katherine J.
Image and Video Processing
Computer Vision and Pattern Recognition
Robotics
New sensing technologies and more advanced processing algorithms are transforming computer-integrated surgery. While researchers are actively investigating depth sensing and 3D reconstruction for vision-based surgical assistance, it remains difficult to achieve real-time, accurate, and robust 3D representations of the abdominal cavity for minimally invasive surgery. Thus, this work uses quantitative testing on fresh ex-vivo porcine tissue to thoroughly characterize the quality with which a 3D laser-based time-of-flight sensor (lidar) can perform anatomical surface reconstruction. Ground-truth surface shapes are captured with a commercial laser scanner, and the resulting signed error fields are analyzed using rigorous statistical tools. When compared to modern learning-based stereo matching from endoscopic images, time-of-flight sensing demonstrates higher precision, lower processing delay, higher frame rate, and superior robustness against sensor distance and poor illumination. Furthermore, we report on the potential negative effect of near-infrared light penetration on the accuracy of lidar measurements across different tissue samples, identifying a significant measured depth offset for muscle in contrast to fat and liver. Our findings highlight the potential of lidar for intraoperative 3D perception and point toward new methods that combine complementary time-of-flight and spectral imaging.
title Dense 3D Reconstruction Through Lidar: A Comparative Study on Ex-vivo Porcine Tissue
topic Image and Video Processing
Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2401.10709