Saved in:
Bibliographic Details
Main Authors: Kong, Mangyu, Lee, Seongwon, Lee, Jaewon, Kim, Euntai
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2406.12202
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916652055003136
author Kong, Mangyu
Lee, Seongwon
Lee, Jaewon
Kim, Euntai
author_facet Kong, Mangyu
Lee, Seongwon
Lee, Jaewon
Kim, Euntai
contents Neural Radiance Fields (NeRF) presented a novel way to represent scenes, allowing for high-quality 3D reconstruction from 2D images. Following its remarkable achievements, global localization within NeRF maps is an essential task for enabling a wide range of applications. Recently, Loc-NeRF demonstrated a localization approach that combines traditional Monte Carlo Localization with NeRF, showing promising results for using NeRF as an environment map. However, despite its advancements, Loc-NeRF encounters the challenge of a time-intensive ray rendering process, which can be a significant limitation in practical applications. To address this issue, we introduce Fast Loc-NeRF, which leverages a coarse-to-fine approach to enable more efficient and accurate NeRF map-based global localization. Specifically, Fast Loc-NeRF matches rendered pixels and observed images on a multi-resolution from low to high resolution. As a result, it speeds up the costly particle update process while maintaining precise localization results. Additionally, to reject the abnormal particles, we propose particle rejection weighting, which estimates the uncertainty of particles by exploiting NeRF's characteristics and considers them in the particle weighting process. Our Fast Loc-NeRF sets new state-of-the-art localization performances on several benchmarks, convincing its accuracy and efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2406_12202
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fast Global Localization on Neural Radiance Field
Kong, Mangyu
Lee, Seongwon
Lee, Jaewon
Kim, Euntai
Robotics
Neural Radiance Fields (NeRF) presented a novel way to represent scenes, allowing for high-quality 3D reconstruction from 2D images. Following its remarkable achievements, global localization within NeRF maps is an essential task for enabling a wide range of applications. Recently, Loc-NeRF demonstrated a localization approach that combines traditional Monte Carlo Localization with NeRF, showing promising results for using NeRF as an environment map. However, despite its advancements, Loc-NeRF encounters the challenge of a time-intensive ray rendering process, which can be a significant limitation in practical applications. To address this issue, we introduce Fast Loc-NeRF, which leverages a coarse-to-fine approach to enable more efficient and accurate NeRF map-based global localization. Specifically, Fast Loc-NeRF matches rendered pixels and observed images on a multi-resolution from low to high resolution. As a result, it speeds up the costly particle update process while maintaining precise localization results. Additionally, to reject the abnormal particles, we propose particle rejection weighting, which estimates the uncertainty of particles by exploiting NeRF's characteristics and considers them in the particle weighting process. Our Fast Loc-NeRF sets new state-of-the-art localization performances on several benchmarks, convincing its accuracy and efficiency.
title Fast Global Localization on Neural Radiance Field
topic Robotics
url https://arxiv.org/abs/2406.12202