ZoomEarth: Active Perception for Ultra-High-Resolution Geospatial Vision-Language Tasks

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liu, Ruixun, Fu, Bowen, Song, Jiayi, Li, Kaiyu, Li, Wanchen, Xue, Lanxuan, Qiao, Hui, Zhang, Weizhan, Meng, Deyu, Cao, Xiangyong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915620506828800
author Liu, Ruixun
Fu, Bowen
Song, Jiayi
Li, Kaiyu
Li, Wanchen
Xue, Lanxuan
Qiao, Hui
Zhang, Weizhan
Meng, Deyu
Cao, Xiangyong
author_facet Liu, Ruixun
Fu, Bowen
Song, Jiayi
Li, Kaiyu
Li, Wanchen
Xue, Lanxuan
Qiao, Hui
Zhang, Weizhan
Meng, Deyu
Cao, Xiangyong
contents Ultra-high-resolution (UHR) remote sensing (RS) images offer rich fine-grained information but also present challenges in effective processing. Existing dynamic resolution and token pruning methods are constrained by a passive perception paradigm, suffering from increased redundancy when obtaining finer visual inputs. In this work, we explore a new active perception paradigm that enables models to revisit information-rich regions. First, we present LRS-GRO, a large-scale benchmark dataset tailored for active perception in UHR RS processing, encompassing 17 question types across global, region, and object levels, annotated via a semi-automatic pipeline. Building on LRS-GRO, we propose ZoomEarth, an adaptive cropping-zooming framework with a novel Region-Guided reward that provides fine-grained guidance. Trained via supervised fine-tuning (SFT) and Group Relative Policy Optimization (GRPO), ZoomEarth achieves state-of-the-art performance on LRS-GRO and, in the zero-shot setting, on three public UHR remote sensing benchmarks. Furthermore, ZoomEarth can be seamlessly integrated with downstream models for tasks such as cloud removal, denoising, segmentation, and image editing through simple tool interfaces, demonstrating strong versatility and extensibility.
format Preprint
id arxiv_https___arxiv_org_abs_2511_12267
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ZoomEarth: Active Perception for Ultra-High-Resolution Geospatial Vision-Language Tasks
Liu, Ruixun
Fu, Bowen
Song, Jiayi
Li, Kaiyu
Li, Wanchen
Xue, Lanxuan
Qiao, Hui
Zhang, Weizhan
Meng, Deyu
Cao, Xiangyong
Computer Vision and Pattern Recognition
Ultra-high-resolution (UHR) remote sensing (RS) images offer rich fine-grained information but also present challenges in effective processing. Existing dynamic resolution and token pruning methods are constrained by a passive perception paradigm, suffering from increased redundancy when obtaining finer visual inputs. In this work, we explore a new active perception paradigm that enables models to revisit information-rich regions. First, we present LRS-GRO, a large-scale benchmark dataset tailored for active perception in UHR RS processing, encompassing 17 question types across global, region, and object levels, annotated via a semi-automatic pipeline. Building on LRS-GRO, we propose ZoomEarth, an adaptive cropping-zooming framework with a novel Region-Guided reward that provides fine-grained guidance. Trained via supervised fine-tuning (SFT) and Group Relative Policy Optimization (GRPO), ZoomEarth achieves state-of-the-art performance on LRS-GRO and, in the zero-shot setting, on three public UHR remote sensing benchmarks. Furthermore, ZoomEarth can be seamlessly integrated with downstream models for tasks such as cloud removal, denoising, segmentation, and image editing through simple tool interfaces, demonstrating strong versatility and extensibility.
title ZoomEarth: Active Perception for Ultra-High-Resolution Geospatial Vision-Language Tasks
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.12267