KidSat: satellite imagery to map childhood poverty dataset and benchmark

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sharma, Makkunda, Yang, Fan, Vo, Duy-Nhat, Suel, Esra, Mishra, Swapnil, Bhatt, Samir, Fiala, Oliver, Rudgard, William, Flaxman, Seth
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916315855323136
author Sharma, Makkunda
Yang, Fan
Vo, Duy-Nhat
Suel, Esra
Mishra, Swapnil
Bhatt, Samir
Fiala, Oliver
Rudgard, William
Flaxman, Seth
author_facet Sharma, Makkunda
Yang, Fan
Vo, Duy-Nhat
Suel, Esra
Mishra, Swapnil
Bhatt, Samir
Fiala, Oliver
Rudgard, William
Flaxman, Seth
contents Satellite imagery has emerged as an important tool to analyse demographic, health, and development indicators. While various deep learning models have been built for these tasks, each is specific to a particular problem, with few standard benchmarks available. We propose a new dataset pairing satellite imagery and high-quality survey data on child poverty to benchmark satellite feature representations. Our dataset consists of 33,608 images, each 10 km $\times$ 10 km, from 19 countries in Eastern and Southern Africa in the time period 1997-2022. As defined by UNICEF, multidimensional child poverty covers six dimensions and it can be calculated from the face-to-face Demographic and Health Surveys (DHS) Program . As part of the benchmark, we test spatial as well as temporal generalization, by testing on unseen locations, and on data after the training years. Using our dataset we benchmark multiple models, from low-level satellite imagery models such as MOSAIKS , to deep learning foundation models, which include both generic vision models such as Self-Distillation with no Labels (DINOv2) models and specific satellite imagery models such as SatMAE. We provide open source code for building the satellite dataset, obtaining ground truth data from DHS and running various models assessed in our work.
format Preprint
id arxiv_https___arxiv_org_abs_2407_05986
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle KidSat: satellite imagery to map childhood poverty dataset and benchmark
Sharma, Makkunda
Yang, Fan
Vo, Duy-Nhat
Suel, Esra
Mishra, Swapnil
Bhatt, Samir
Fiala, Oliver
Rudgard, William
Flaxman, Seth
Computer Vision and Pattern Recognition
Machine Learning
Satellite imagery has emerged as an important tool to analyse demographic, health, and development indicators. While various deep learning models have been built for these tasks, each is specific to a particular problem, with few standard benchmarks available. We propose a new dataset pairing satellite imagery and high-quality survey data on child poverty to benchmark satellite feature representations. Our dataset consists of 33,608 images, each 10 km $\times$ 10 km, from 19 countries in Eastern and Southern Africa in the time period 1997-2022. As defined by UNICEF, multidimensional child poverty covers six dimensions and it can be calculated from the face-to-face Demographic and Health Surveys (DHS) Program . As part of the benchmark, we test spatial as well as temporal generalization, by testing on unseen locations, and on data after the training years. Using our dataset we benchmark multiple models, from low-level satellite imagery models such as MOSAIKS , to deep learning foundation models, which include both generic vision models such as Self-Distillation with no Labels (DINOv2) models and specific satellite imagery models such as SatMAE. We provide open source code for building the satellite dataset, obtaining ground truth data from DHS and running various models assessed in our work.
title KidSat: satellite imagery to map childhood poverty dataset and benchmark
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2407.05986