LUDO: Low-Latency Understanding of Deformable Objects using Point Cloud Occupancy Functions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Henrich, Pit, Mathis-Ullrich, Franziska, Scheikl, Paul Maria
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912461413679104
author Henrich, Pit
Mathis-Ullrich, Franziska
Scheikl, Paul Maria
author_facet Henrich, Pit
Mathis-Ullrich, Franziska
Scheikl, Paul Maria
contents Accurately determining the shape of deformable objects and the location of their internal structures is crucial for medical tasks that require precise targeting, such as robotic biopsies. We introduce LUDO, a method for accurate low-latency understanding of deformable objects. LUDO reconstructs objects in their deformed state, including their internal structures, from a single-view point cloud observation in under 30 ms using occupancy networks. LUDO provides uncertainty estimates for its predictions. Additionally, it provides explainability by highlighting key features in its input observations. Both uncertainty and explainability are important for safety-critical applications such as surgery. We evaluate LUDO in real-world robotic experiments, achieving a success rate of 98.9% for puncturing various regions of interest (ROIs) inside deformable objects. We compare LUDO to a popular baseline and show its superior ROI localization accuracy, training time, and memory requirements. LUDO demonstrates the potential to interact with deformable objects without the need for deformable registration methods.
format Preprint
id arxiv_https___arxiv_org_abs_2411_08777
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle LUDO: Low-Latency Understanding of Deformable Objects using Point Cloud Occupancy Functions
Henrich, Pit
Mathis-Ullrich, Franziska
Scheikl, Paul Maria
Robotics
Computer Vision and Pattern Recognition
Accurately determining the shape of deformable objects and the location of their internal structures is crucial for medical tasks that require precise targeting, such as robotic biopsies. We introduce LUDO, a method for accurate low-latency understanding of deformable objects. LUDO reconstructs objects in their deformed state, including their internal structures, from a single-view point cloud observation in under 30 ms using occupancy networks. LUDO provides uncertainty estimates for its predictions. Additionally, it provides explainability by highlighting key features in its input observations. Both uncertainty and explainability are important for safety-critical applications such as surgery. We evaluate LUDO in real-world robotic experiments, achieving a success rate of 98.9% for puncturing various regions of interest (ROIs) inside deformable objects. We compare LUDO to a popular baseline and show its superior ROI localization accuracy, training time, and memory requirements. LUDO demonstrates the potential to interact with deformable objects without the need for deformable registration methods.
title LUDO: Low-Latency Understanding of Deformable Objects using Point Cloud Occupancy Functions
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.08777