NARUTO: Neural Active Reconstruction from Uncertain Target Observations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Feng, Ziyue, Zhan, Huangying, Chen, Zheng, Yan, Qingan, Xu, Xiangyu, Cai, Changjiang, Li, Bing, Zhu, Qilun, Xu, Yi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913318026870784
author Feng, Ziyue
Zhan, Huangying
Chen, Zheng
Yan, Qingan
Xu, Xiangyu
Cai, Changjiang
Li, Bing
Zhu, Qilun
Xu, Yi
author_facet Feng, Ziyue
Zhan, Huangying
Chen, Zheng
Yan, Qingan
Xu, Xiangyu
Cai, Changjiang
Li, Bing
Zhu, Qilun
Xu, Yi
contents We present NARUTO, a neural active reconstruction system that combines a hybrid neural representation with uncertainty learning, enabling high-fidelity surface reconstruction. Our approach leverages a multi-resolution hash-grid as the mapping backbone, chosen for its exceptional convergence speed and capacity to capture high-frequency local features.The centerpiece of our work is the incorporation of an uncertainty learning module that dynamically quantifies reconstruction uncertainty while actively reconstructing the environment. By harnessing learned uncertainty, we propose a novel uncertainty aggregation strategy for goal searching and efficient path planning. Our system autonomously explores by targeting uncertain observations and reconstructs environments with remarkable completeness and fidelity. We also demonstrate the utility of this uncertainty-aware approach by enhancing SOTA neural SLAM systems through an active ray sampling strategy. Extensive evaluations of NARUTO in various environments, using an indoor scene simulator, confirm its superior performance and state-of-the-art status in active reconstruction, as evidenced by its impressive results on benchmark datasets like Replica and MP3D.
format Preprint
id arxiv_https___arxiv_org_abs_2402_18771
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle NARUTO: Neural Active Reconstruction from Uncertain Target Observations
Feng, Ziyue
Zhan, Huangying
Chen, Zheng
Yan, Qingan
Xu, Xiangyu
Cai, Changjiang
Li, Bing
Zhu, Qilun
Xu, Yi
Computer Vision and Pattern Recognition
Robotics
We present NARUTO, a neural active reconstruction system that combines a hybrid neural representation with uncertainty learning, enabling high-fidelity surface reconstruction. Our approach leverages a multi-resolution hash-grid as the mapping backbone, chosen for its exceptional convergence speed and capacity to capture high-frequency local features.The centerpiece of our work is the incorporation of an uncertainty learning module that dynamically quantifies reconstruction uncertainty while actively reconstructing the environment. By harnessing learned uncertainty, we propose a novel uncertainty aggregation strategy for goal searching and efficient path planning. Our system autonomously explores by targeting uncertain observations and reconstructs environments with remarkable completeness and fidelity. We also demonstrate the utility of this uncertainty-aware approach by enhancing SOTA neural SLAM systems through an active ray sampling strategy. Extensive evaluations of NARUTO in various environments, using an indoor scene simulator, confirm its superior performance and state-of-the-art status in active reconstruction, as evidenced by its impressive results on benchmark datasets like Replica and MP3D.
title NARUTO: Neural Active Reconstruction from Uncertain Target Observations
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2402.18771