UW-SDF: Exploiting Hybrid Geometric Priors for Neural SDF Reconstruction from Underwater Multi-view Monocular Images

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Zeyu, Tang, Jingyi, Wang, Gu, Li, Shengquan, Li, Xinghui, Ji, Xiangyang, Li, Xiu
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909344408272896
author Chen, Zeyu
Tang, Jingyi
Wang, Gu
Li, Shengquan
Li, Xinghui
Ji, Xiangyang
Li, Xiu
author_facet Chen, Zeyu
Tang, Jingyi
Wang, Gu
Li, Shengquan
Li, Xinghui
Ji, Xiangyang
Li, Xiu
contents Due to the unique characteristics of underwater environments, accurate 3D reconstruction of underwater objects poses a challenging problem in tasks such as underwater exploration and mapping. Traditional methods that rely on multiple sensor data for 3D reconstruction are time-consuming and face challenges in data acquisition in underwater scenarios. We propose UW-SDF, a framework for reconstructing target objects from multi-view underwater images based on neural SDF. We introduce hybrid geometric priors to optimize the reconstruction process, markedly enhancing the quality and efficiency of neural SDF reconstruction. Additionally, to address the challenge of segmentation consistency in multi-view images, we propose a novel few-shot multi-view target segmentation strategy using the general-purpose segmentation model (SAM), enabling rapid automatic segmentation of unseen objects. Through extensive qualitative and quantitative experiments on diverse datasets, we demonstrate that our proposed method outperforms the traditional underwater 3D reconstruction method and other neural rendering approaches in the field of underwater 3D reconstruction.
format Preprint
id arxiv_https___arxiv_org_abs_2410_08092
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle UW-SDF: Exploiting Hybrid Geometric Priors for Neural SDF Reconstruction from Underwater Multi-view Monocular Images
Chen, Zeyu
Tang, Jingyi
Wang, Gu
Li, Shengquan
Li, Xinghui
Ji, Xiangyang
Li, Xiu
Computer Vision and Pattern Recognition
Robotics
Due to the unique characteristics of underwater environments, accurate 3D reconstruction of underwater objects poses a challenging problem in tasks such as underwater exploration and mapping. Traditional methods that rely on multiple sensor data for 3D reconstruction are time-consuming and face challenges in data acquisition in underwater scenarios. We propose UW-SDF, a framework for reconstructing target objects from multi-view underwater images based on neural SDF. We introduce hybrid geometric priors to optimize the reconstruction process, markedly enhancing the quality and efficiency of neural SDF reconstruction. Additionally, to address the challenge of segmentation consistency in multi-view images, we propose a novel few-shot multi-view target segmentation strategy using the general-purpose segmentation model (SAM), enabling rapid automatic segmentation of unseen objects. Through extensive qualitative and quantitative experiments on diverse datasets, we demonstrate that our proposed method outperforms the traditional underwater 3D reconstruction method and other neural rendering approaches in the field of underwater 3D reconstruction.
title UW-SDF: Exploiting Hybrid Geometric Priors for Neural SDF Reconstruction from Underwater Multi-view Monocular Images
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2410.08092