OpenEarthSensing: Large-Scale Fine-Grained Benchmark for Open-World Remote Sensing

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Xiang, Xiang, Xu, Zhuo, Deng, Yao, Zhou, Qinhao, Liang, Yifan, Chen, Ke, Zheng, Qingfang, Wang, Yaowei, Chen, Xilin, Gao, Wen
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916870107430912
author Xiang, Xiang
Xu, Zhuo
Deng, Yao
Zhou, Qinhao
Liang, Yifan
Chen, Ke
Zheng, Qingfang
Wang, Yaowei
Chen, Xilin
Gao, Wen
author_facet Xiang, Xiang
Xu, Zhuo
Deng, Yao
Zhou, Qinhao
Liang, Yifan
Chen, Ke
Zheng, Qingfang
Wang, Yaowei
Chen, Xilin
Gao, Wen
contents The advancement of remote sensing, including satellite systems, facilitates the continuous acquisition of remote sensing imagery globally, introducing novel challenges for achieving open-world tasks. Deployed models need to continuously adjust to a constant influx of new data, which frequently exhibits diverse shifts from the data encountered during the training phase. To effectively handle the new data, models are required to detect semantic shifts, adapt to covariate shifts, and continuously update their parameters without forgetting learned knowledge, as has been considered in works on a variety of open-world tasks. However, existing studies are typically conducted within a single dataset to simulate realistic conditions, with a lack of large-scale benchmarks capable of evaluating multiple open-world tasks. In this paper, we introduce \textbf{OpenEarthSensing (OES)}, a large-scale fine-grained benchmark for open-world remote sensing. OES includes 189 scene and object categories, covering the vast majority of potential semantic shifts that may occur in the real world. Additionally, to provide a more comprehensive testbed for evaluating the generalization performance, OES encompasses five data domains with significant covariate shifts, including two RGB satellite domains, one RGB aerial domain, one multispectral RGB domain, and one infrared domain. We evaluate the baselines and existing methods for diverse tasks on OES, demonstrating that it serves as a meaningful and challenging benchmark for open-world remote sensing. The proposed dataset OES is available at https://haiv-lab.github.io/OES.
format Preprint
id arxiv_https___arxiv_org_abs_2502_20668
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle OpenEarthSensing: Large-Scale Fine-Grained Benchmark for Open-World Remote Sensing
Xiang, Xiang
Xu, Zhuo
Deng, Yao
Zhou, Qinhao
Liang, Yifan
Chen, Ke
Zheng, Qingfang
Wang, Yaowei
Chen, Xilin
Gao, Wen
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Image and Video Processing
The advancement of remote sensing, including satellite systems, facilitates the continuous acquisition of remote sensing imagery globally, introducing novel challenges for achieving open-world tasks. Deployed models need to continuously adjust to a constant influx of new data, which frequently exhibits diverse shifts from the data encountered during the training phase. To effectively handle the new data, models are required to detect semantic shifts, adapt to covariate shifts, and continuously update their parameters without forgetting learned knowledge, as has been considered in works on a variety of open-world tasks. However, existing studies are typically conducted within a single dataset to simulate realistic conditions, with a lack of large-scale benchmarks capable of evaluating multiple open-world tasks. In this paper, we introduce \textbf{OpenEarthSensing (OES)}, a large-scale fine-grained benchmark for open-world remote sensing. OES includes 189 scene and object categories, covering the vast majority of potential semantic shifts that may occur in the real world. Additionally, to provide a more comprehensive testbed for evaluating the generalization performance, OES encompasses five data domains with significant covariate shifts, including two RGB satellite domains, one RGB aerial domain, one multispectral RGB domain, and one infrared domain. We evaluate the baselines and existing methods for diverse tasks on OES, demonstrating that it serves as a meaningful and challenging benchmark for open-world remote sensing. The proposed dataset OES is available at https://haiv-lab.github.io/OES.
title OpenEarthSensing: Large-Scale Fine-Grained Benchmark for Open-World Remote Sensing
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Image and Video Processing
url https://arxiv.org/abs/2502.20668