Saved in:
Bibliographic Details
Main Authors: Zhang, Sixian, Wang, Yiyao, Song, Xinhang, Zhang, Keming, Xu, Zijian, Jiang, Shuqiang
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2605.01736
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911642783055872
author Zhang, Sixian
Wang, Yiyao
Song, Xinhang
Zhang, Keming
Xu, Zijian
Jiang, Shuqiang
author_facet Zhang, Sixian
Wang, Yiyao
Song, Xinhang
Zhang, Keming
Xu, Zijian
Jiang, Shuqiang
contents Understanding the geometric and semantic structure of environments is essential for embodied navigation and reasoning. Existing semantic mapping methods trade off between explicit geometry and multi-scale semantics, and lack a native interface for large models, thus requiring additional training of feature projection for semantic alignment. To this end, we propose the multi-scale Gaussian-Language Map (GLMap), which introduces three key designs: (1) explicit geometry, (2) multi-scale semantics covering both instance and region concepts, and (3) a dual-modality interface where each semantic unit jointly stores a natural language description and a 3D Gaussian representation. The 3D Gaussians enable compact storage and fast rendering of task-relevant images via Gaussian splatting. To enable efficient incremental construction, we further propose a Gaussian Estimator that analytically derives Gaussian parameters from dense point clouds without gradient-based optimization. Experiments on ObjectNav, InstNav, and SQA tasks show that GLMap effectively enhances target navigation and contextual reasoning, while remaining compatible with large-model-based methods in a zero-shot manner. The code is available at https://github.com/sx-zhang/GLMap.
format Preprint
id arxiv_https___arxiv_org_abs_2605_01736
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Multi-Scale Gaussian-Language Map for Zero-shot Embodied Navigation and Reasoning
Zhang, Sixian
Wang, Yiyao
Song, Xinhang
Zhang, Keming
Xu, Zijian
Jiang, Shuqiang
Computer Vision and Pattern Recognition
Understanding the geometric and semantic structure of environments is essential for embodied navigation and reasoning. Existing semantic mapping methods trade off between explicit geometry and multi-scale semantics, and lack a native interface for large models, thus requiring additional training of feature projection for semantic alignment. To this end, we propose the multi-scale Gaussian-Language Map (GLMap), which introduces three key designs: (1) explicit geometry, (2) multi-scale semantics covering both instance and region concepts, and (3) a dual-modality interface where each semantic unit jointly stores a natural language description and a 3D Gaussian representation. The 3D Gaussians enable compact storage and fast rendering of task-relevant images via Gaussian splatting. To enable efficient incremental construction, we further propose a Gaussian Estimator that analytically derives Gaussian parameters from dense point clouds without gradient-based optimization. Experiments on ObjectNav, InstNav, and SQA tasks show that GLMap effectively enhances target navigation and contextual reasoning, while remaining compatible with large-model-based methods in a zero-shot manner. The code is available at https://github.com/sx-zhang/GLMap.
title Multi-Scale Gaussian-Language Map for Zero-shot Embodied Navigation and Reasoning
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.01736