GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Grounding

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Peirong, Zhang, Yidan, Xu, Luxiao, Lin, Jinliang, Guo, Zonghao, Wang, Fengxiang, Yang, Xue, Wei, Kaiwen, Wang, Lei
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909940288847872
author Zhang, Peirong
Zhang, Yidan
Xu, Luxiao
Lin, Jinliang
Guo, Zonghao
Wang, Fengxiang
Yang, Xue
Wei, Kaiwen
Wang, Lei
author_facet Zhang, Peirong
Zhang, Yidan
Xu, Luxiao
Lin, Jinliang
Guo, Zonghao
Wang, Fengxiang
Yang, Xue
Wei, Kaiwen
Wang, Lei
contents Recent advances in multimodal large language models(MLLMs) have led to remarkable progress in visual grounding, enabling fine-grained cross-modal alignment between textual queries and image regions. However, transferring such capabilities to remote sensing imagery remains challenging, as targets are often extremely small within kilometer-scale scenes, and queries typically involve intricate geospatial relations such as relative positions, spatial hierarchies, or contextual dependencies across distant objects. To address these challenges, we propose GeoViS, a Geospatially Rewarded Visual Search framework that reformulates remote sensing visual grounding as a progressive search-and-reasoning process. Rather than directly predicting the target location in a single step, GeoViS actively explores the global image through a tree-structured sequence of visual cues, integrating multimodal perception, spatial reasoning, and reward-guided exploration to refine geospatial hypotheses iteratively. This design enables the model to detect subtle small-scale targets while maintaining holistic scene awareness. Extensive experiments on five remote sensing grounding benchmarks demonstrate that GeoViS achieves precise geospatial understanding and consistently surpasses existing methods across key visual grounding metrics, highlighting its strong cross-domain generalization and interpretability.
format Preprint
id arxiv_https___arxiv_org_abs_2512_02715
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Grounding
Zhang, Peirong
Zhang, Yidan
Xu, Luxiao
Lin, Jinliang
Guo, Zonghao
Wang, Fengxiang
Yang, Xue
Wei, Kaiwen
Wang, Lei
Computer Vision and Pattern Recognition
Recent advances in multimodal large language models(MLLMs) have led to remarkable progress in visual grounding, enabling fine-grained cross-modal alignment between textual queries and image regions. However, transferring such capabilities to remote sensing imagery remains challenging, as targets are often extremely small within kilometer-scale scenes, and queries typically involve intricate geospatial relations such as relative positions, spatial hierarchies, or contextual dependencies across distant objects. To address these challenges, we propose GeoViS, a Geospatially Rewarded Visual Search framework that reformulates remote sensing visual grounding as a progressive search-and-reasoning process. Rather than directly predicting the target location in a single step, GeoViS actively explores the global image through a tree-structured sequence of visual cues, integrating multimodal perception, spatial reasoning, and reward-guided exploration to refine geospatial hypotheses iteratively. This design enables the model to detect subtle small-scale targets while maintaining holistic scene awareness. Extensive experiments on five remote sensing grounding benchmarks demonstrate that GeoViS achieves precise geospatial understanding and consistently surpasses existing methods across key visual grounding metrics, highlighting its strong cross-domain generalization and interpretability.
title GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Grounding
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.02715