Iterative PnP and its application in 3D-2D vascular image registration for robot navigation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Song, Jingwei, Yang, Keke, Zhang, Zheng, Li, Meng, Cao, Tuoyu, Ghaffari, Maani
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913191701774336
author Song, Jingwei
Yang, Keke
Zhang, Zheng
Li, Meng
Cao, Tuoyu
Ghaffari, Maani
author_facet Song, Jingwei
Yang, Keke
Zhang, Zheng
Li, Meng
Cao, Tuoyu
Ghaffari, Maani
contents This paper reports on a new real-time robot-centered 3D-2D vascular image alignment algorithm, which is robust to outliers and can align nonrigid shapes. Few works have managed to achieve both real-time and accurate performance for vascular intervention robots. This work bridges high-accuracy 3D-2D registration techniques and computational efficiency requirements in intervention robot applications. We categorize centerline-based vascular 3D-2D image registration problems as an iterative Perspective-n-Point (PnP) problem and propose to use the Levenberg-Marquardt solver on the Lie manifold. Then, the recently developed Reproducing Kernel Hilbert Space (RKHS) algorithm is introduced to overcome the ``big-to-small'' problem in typical robotic scenarios. Finally, an iterative reweighted least squares is applied to solve RKHS-based formulation efficiently. Experiments indicate that the proposed algorithm processes registration over 50 Hz (rigid) and 20 Hz (nonrigid) and obtains competing registration accuracy similar to other works. Results indicate that our Iterative PnP is suitable for future vascular intervention robot applications.
format Preprint
id arxiv_https___arxiv_org_abs_2310_12551
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Iterative PnP and its application in 3D-2D vascular image registration for robot navigation
Song, Jingwei
Yang, Keke
Zhang, Zheng
Li, Meng
Cao, Tuoyu
Ghaffari, Maani
Robotics
Image and Video Processing
This paper reports on a new real-time robot-centered 3D-2D vascular image alignment algorithm, which is robust to outliers and can align nonrigid shapes. Few works have managed to achieve both real-time and accurate performance for vascular intervention robots. This work bridges high-accuracy 3D-2D registration techniques and computational efficiency requirements in intervention robot applications. We categorize centerline-based vascular 3D-2D image registration problems as an iterative Perspective-n-Point (PnP) problem and propose to use the Levenberg-Marquardt solver on the Lie manifold. Then, the recently developed Reproducing Kernel Hilbert Space (RKHS) algorithm is introduced to overcome the ``big-to-small'' problem in typical robotic scenarios. Finally, an iterative reweighted least squares is applied to solve RKHS-based formulation efficiently. Experiments indicate that the proposed algorithm processes registration over 50 Hz (rigid) and 20 Hz (nonrigid) and obtains competing registration accuracy similar to other works. Results indicate that our Iterative PnP is suitable for future vascular intervention robot applications.
title Iterative PnP and its application in 3D-2D vascular image registration for robot navigation
topic Robotics
Image and Video Processing
url https://arxiv.org/abs/2310.12551