Uncertainty-Aware Regression for Socio-Economic Estimation via Multi-View Remote Sensing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Yang, Fan, Ishida, Sahoko, Zhang, Mengyan, Jenson, Daniel, Mishra, Swapnil, Navott, Jhonathan, Flaxman, Seth
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915029575532544
author Yang, Fan
Ishida, Sahoko
Zhang, Mengyan
Jenson, Daniel
Mishra, Swapnil
Navott, Jhonathan
Flaxman, Seth
author_facet Yang, Fan
Ishida, Sahoko
Zhang, Mengyan
Jenson, Daniel
Mishra, Swapnil
Navott, Jhonathan
Flaxman, Seth
contents Remote sensing imagery offers rich spectral data across extensive areas for Earth observation. Many attempts have been made to leverage these data with transfer learning to develop scalable alternatives for estimating socio-economic conditions, reducing reliance on expensive survey-collected data. However, much of this research has primarily focused on daytime satellite imagery due to the limitation that most pre-trained models are trained on 3-band RGB images. Consequently, modeling techniques for spectral bands beyond the visible spectrum have not been thoroughly investigated. Additionally, quantifying uncertainty in remote sensing regression has been less explored, yet it is essential for more informed targeting and iterative collection of ground truth survey data. In this paper, we introduce a novel framework that leverages generic foundational vision models to process remote sensing imagery using combinations of three spectral bands to exploit multi-spectral data. We also employ methods such as heteroscedastic regression and Bayesian modeling to generate uncertainty estimates for the predictions. Experimental results demonstrate that our method outperforms existing models that use RGB or multi-spectral models with unstructured band usage. Moreover, our framework helps identify uncertain predictions, guiding future ground truth data acquisition.
format Preprint
id arxiv_https___arxiv_org_abs_2411_14119
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Uncertainty-Aware Regression for Socio-Economic Estimation via Multi-View Remote Sensing
Yang, Fan
Ishida, Sahoko
Zhang, Mengyan
Jenson, Daniel
Mishra, Swapnil
Navott, Jhonathan
Flaxman, Seth
Computer Vision and Pattern Recognition
Remote sensing imagery offers rich spectral data across extensive areas for Earth observation. Many attempts have been made to leverage these data with transfer learning to develop scalable alternatives for estimating socio-economic conditions, reducing reliance on expensive survey-collected data. However, much of this research has primarily focused on daytime satellite imagery due to the limitation that most pre-trained models are trained on 3-band RGB images. Consequently, modeling techniques for spectral bands beyond the visible spectrum have not been thoroughly investigated. Additionally, quantifying uncertainty in remote sensing regression has been less explored, yet it is essential for more informed targeting and iterative collection of ground truth survey data. In this paper, we introduce a novel framework that leverages generic foundational vision models to process remote sensing imagery using combinations of three spectral bands to exploit multi-spectral data. We also employ methods such as heteroscedastic regression and Bayesian modeling to generate uncertainty estimates for the predictions. Experimental results demonstrate that our method outperforms existing models that use RGB or multi-spectral models with unstructured band usage. Moreover, our framework helps identify uncertain predictions, guiding future ground truth data acquisition.
title Uncertainty-Aware Regression for Socio-Economic Estimation via Multi-View Remote Sensing
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2411.14119