ProVG: Progressive Visual Grounding via Language Decoupling for Remote Sensing Imagery

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Li, Ke, Wang, Ting, Wang, Di, Zhu, Yongshan, Zhang, Yiming, Lei, Tao, Wang, Quan
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918425483280384
author Li, Ke
Wang, Ting
Wang, Di
Zhu, Yongshan
Zhang, Yiming
Lei, Tao
Wang, Quan
author_facet Li, Ke
Wang, Ting
Wang, Di
Zhu, Yongshan
Zhang, Yiming
Lei, Tao
Wang, Quan
contents Remote sensing visual grounding (RSVG) aims to localize objects in remote sensing imagery according to natural language expressions. Previous methods typically rely on sentence-level vision-language alignment, which struggles to exploit fine-grained linguistic cues, such as \textit{spatial relations} and \textit{object attributes}, that are crucial for distinguishing objects with similar characteristics. Importantly, these cues play distinct roles across different grounding stages and should be leveraged accordingly to provide more explicit guidance. In this work, we propose \textbf{ProVG}, a novel RSVG framework that improves localization accuracy by decoupling language expressions into global context, spatial relations, and object attributes. To integrate these linguistic cues, ProVG employs a simple yet effective progressive cross-modal modulator, which dynamically modulates visual attention through a \textit{survey-locate-verify} scheme, enabling coarse-to-fine vision-language alignment. In addition, ProVG incorporates a cross-scale fusion module to mitigate the large-scale variations in remote sensing imagery, along with a language-guided calibration decoder to refine cross-modal alignment during prediction. A unified multi-task head further enables ProVG to support both referring expression comprehension and segmentation tasks. Extensive experiments on two benchmarks, \textit{i.e.}, RRSIS-D and RISBench, demonstrate that ProVG consistently outperforms existing methods, achieving new state-of-the-art performance.
format Preprint
id arxiv_https___arxiv_org_abs_2604_01893
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ProVG: Progressive Visual Grounding via Language Decoupling for Remote Sensing Imagery
Li, Ke
Wang, Ting
Wang, Di
Zhu, Yongshan
Zhang, Yiming
Lei, Tao
Wang, Quan
Computer Vision and Pattern Recognition
Remote sensing visual grounding (RSVG) aims to localize objects in remote sensing imagery according to natural language expressions. Previous methods typically rely on sentence-level vision-language alignment, which struggles to exploit fine-grained linguistic cues, such as \textit{spatial relations} and \textit{object attributes}, that are crucial for distinguishing objects with similar characteristics. Importantly, these cues play distinct roles across different grounding stages and should be leveraged accordingly to provide more explicit guidance. In this work, we propose \textbf{ProVG}, a novel RSVG framework that improves localization accuracy by decoupling language expressions into global context, spatial relations, and object attributes. To integrate these linguistic cues, ProVG employs a simple yet effective progressive cross-modal modulator, which dynamically modulates visual attention through a \textit{survey-locate-verify} scheme, enabling coarse-to-fine vision-language alignment. In addition, ProVG incorporates a cross-scale fusion module to mitigate the large-scale variations in remote sensing imagery, along with a language-guided calibration decoder to refine cross-modal alignment during prediction. A unified multi-task head further enables ProVG to support both referring expression comprehension and segmentation tasks. Extensive experiments on two benchmarks, \textit{i.e.}, RRSIS-D and RISBench, demonstrate that ProVG consistently outperforms existing methods, achieving new state-of-the-art performance.
title ProVG: Progressive Visual Grounding via Language Decoupling for Remote Sensing Imagery
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.01893