Reg-NF: Efficient Registration of Implicit Surfaces within Neural Fields

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hausler, Stephen, Hall, David, Mahendren, Sutharsan, Moghadam, Peyman
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929244267872256
author Hausler, Stephen
Hall, David
Mahendren, Sutharsan
Moghadam, Peyman
author_facet Hausler, Stephen
Hall, David
Mahendren, Sutharsan
Moghadam, Peyman
contents Neural fields, coordinate-based neural networks, have recently gained popularity for implicitly representing a scene. In contrast to classical methods that are based on explicit representations such as point clouds, neural fields provide a continuous scene representation able to represent 3D geometry and appearance in a way which is compact and ideal for robotics applications. However, limited prior methods have investigated registering multiple neural fields by directly utilising these continuous implicit representations. In this paper, we present Reg-NF, a neural fields-based registration that optimises for the relative 6-DoF transformation between two arbitrary neural fields, even if those two fields have different scale factors. Key components of Reg-NF include a bidirectional registration loss, multi-view surface sampling, and utilisation of volumetric signed distance functions (SDFs). We showcase our approach on a new neural field dataset for evaluating registration problems. We provide an exhaustive set of experiments and ablation studies to identify the performance of our approach, while also discussing limitations to provide future direction to the research community on open challenges in utilizing neural fields in unconstrained environments.
format Preprint
id arxiv_https___arxiv_org_abs_2402_09722
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Reg-NF: Efficient Registration of Implicit Surfaces within Neural Fields
Hausler, Stephen
Hall, David
Mahendren, Sutharsan
Moghadam, Peyman
Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
Neural fields, coordinate-based neural networks, have recently gained popularity for implicitly representing a scene. In contrast to classical methods that are based on explicit representations such as point clouds, neural fields provide a continuous scene representation able to represent 3D geometry and appearance in a way which is compact and ideal for robotics applications. However, limited prior methods have investigated registering multiple neural fields by directly utilising these continuous implicit representations. In this paper, we present Reg-NF, a neural fields-based registration that optimises for the relative 6-DoF transformation between two arbitrary neural fields, even if those two fields have different scale factors. Key components of Reg-NF include a bidirectional registration loss, multi-view surface sampling, and utilisation of volumetric signed distance functions (SDFs). We showcase our approach on a new neural field dataset for evaluating registration problems. We provide an exhaustive set of experiments and ablation studies to identify the performance of our approach, while also discussing limitations to provide future direction to the research community on open challenges in utilizing neural fields in unconstrained environments.
title Reg-NF: Efficient Registration of Implicit Surfaces within Neural Fields
topic Robotics
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.09722