Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yan, Dongyu, Liu, Jianheng, Quan, Fengyu, Chen, Haoyao, Fu, Mengmeng
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866907915908022272
author Yan, Dongyu
Liu, Jianheng
Quan, Fengyu
Chen, Haoyao
Fu, Mengmeng
author_facet Yan, Dongyu
Liu, Jianheng
Quan, Fengyu
Chen, Haoyao
Fu, Mengmeng
contents Actively planning sensor views during object reconstruction is crucial for autonomous mobile robots. An effective method should be able to strike a balance between accuracy and efficiency. In this paper, we propose a seamless integration of the emerging implicit representation with the active reconstruction task. We build an implicit occupancy field as our geometry proxy. While training, the prior object bounding box is utilized as auxiliary information to generate clean and detailed reconstructions. To evaluate view uncertainty, we employ a sampling-based approach that directly extracts entropy from the reconstructed occupancy probability field as our measure of view information gain. This eliminates the need for additional uncertainty maps or learning. Unlike previous methods that compare view uncertainty within a finite set of candidates, we aim to find the next-best-view (NBV) on a continuous manifold. Leveraging the differentiability of the implicit representation, the NBV can be optimized directly by maximizing the view uncertainty using gradient descent. It significantly enhances the method's adaptability to different scenarios. Simulation and real-world experiments demonstrate that our approach effectively improves reconstruction accuracy and efficiency of view planning in active reconstruction tasks. The proposed system will open source at https://github.com/HITSZ-NRSL/ActiveImplicitRecon.git.
format Preprint
id arxiv_https___arxiv_org_abs_2303_16739
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimization
Yan, Dongyu
Liu, Jianheng
Quan, Fengyu
Chen, Haoyao
Fu, Mengmeng
Robotics
Computer Vision and Pattern Recognition
Actively planning sensor views during object reconstruction is crucial for autonomous mobile robots. An effective method should be able to strike a balance between accuracy and efficiency. In this paper, we propose a seamless integration of the emerging implicit representation with the active reconstruction task. We build an implicit occupancy field as our geometry proxy. While training, the prior object bounding box is utilized as auxiliary information to generate clean and detailed reconstructions. To evaluate view uncertainty, we employ a sampling-based approach that directly extracts entropy from the reconstructed occupancy probability field as our measure of view information gain. This eliminates the need for additional uncertainty maps or learning. Unlike previous methods that compare view uncertainty within a finite set of candidates, we aim to find the next-best-view (NBV) on a continuous manifold. Leveraging the differentiability of the implicit representation, the NBV can be optimized directly by maximizing the view uncertainty using gradient descent. It significantly enhances the method's adaptability to different scenarios. Simulation and real-world experiments demonstrate that our approach effectively improves reconstruction accuracy and efficiency of view planning in active reconstruction tasks. The proposed system will open source at https://github.com/HITSZ-NRSL/ActiveImplicitRecon.git.
title Active Implicit Object Reconstruction using Uncertainty-guided Next-Best-View Optimization
topic Robotics
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2303.16739