Hierarchical Scoring with 3D Gaussian Splatting for Instance Image-Goal Navigation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Deng, Yijie, Yuan, Shuaihang, Bethala, Geeta Chandra Raju, Tzes, Anthony, Liu, Yu-Shen, Fang, Yi
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912419074277376
author Deng, Yijie
Yuan, Shuaihang
Bethala, Geeta Chandra Raju
Tzes, Anthony
Liu, Yu-Shen
Fang, Yi
author_facet Deng, Yijie
Yuan, Shuaihang
Bethala, Geeta Chandra Raju
Tzes, Anthony
Liu, Yu-Shen
Fang, Yi
contents Instance Image-Goal Navigation (IIN) requires autonomous agents to identify and navigate to a target object or location depicted in a reference image captured from any viewpoint. While recent methods leverage powerful novel view synthesis (NVS) techniques, such as three-dimensional Gaussian splatting (3DGS), they typically rely on randomly sampling multiple viewpoints or trajectories to ensure comprehensive coverage of discriminative visual cues. This approach, however, creates significant redundancy through overlapping image samples and lacks principled view selection, substantially increasing both rendering and comparison overhead. In this paper, we introduce a novel IIN framework with a hierarchical scoring paradigm that estimates optimal viewpoints for target matching. Our approach integrates cross-level semantic scoring, utilizing CLIP-derived relevancy fields to identify regions with high semantic similarity to the target object class, with fine-grained local geometric scoring that performs precise pose estimation within promising regions. Extensive evaluations demonstrate that our method achieves state-of-the-art performance on simulated IIN benchmarks and real-world applicability.
format Preprint
id arxiv_https___arxiv_org_abs_2506_07338
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Hierarchical Scoring with 3D Gaussian Splatting for Instance Image-Goal Navigation
Deng, Yijie
Yuan, Shuaihang
Bethala, Geeta Chandra Raju
Tzes, Anthony
Liu, Yu-Shen
Fang, Yi
Computer Vision and Pattern Recognition
Robotics
Instance Image-Goal Navigation (IIN) requires autonomous agents to identify and navigate to a target object or location depicted in a reference image captured from any viewpoint. While recent methods leverage powerful novel view synthesis (NVS) techniques, such as three-dimensional Gaussian splatting (3DGS), they typically rely on randomly sampling multiple viewpoints or trajectories to ensure comprehensive coverage of discriminative visual cues. This approach, however, creates significant redundancy through overlapping image samples and lacks principled view selection, substantially increasing both rendering and comparison overhead. In this paper, we introduce a novel IIN framework with a hierarchical scoring paradigm that estimates optimal viewpoints for target matching. Our approach integrates cross-level semantic scoring, utilizing CLIP-derived relevancy fields to identify regions with high semantic similarity to the target object class, with fine-grained local geometric scoring that performs precise pose estimation within promising regions. Extensive evaluations demonstrate that our method achieves state-of-the-art performance on simulated IIN benchmarks and real-world applicability.
title Hierarchical Scoring with 3D Gaussian Splatting for Instance Image-Goal Navigation
topic Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2506.07338