Combining Satellite and Weather Data for Crop Type Mapping: An Inverse Modelling Approach

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ravirathinam, Praveen, Ghosh, Rahul, Khandelwal, Ankush, Jia, Xiaowei, Mulla, David, Kumar, Vipin
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909085309337600
author Ravirathinam, Praveen
Ghosh, Rahul
Khandelwal, Ankush
Jia, Xiaowei
Mulla, David
Kumar, Vipin
author_facet Ravirathinam, Praveen
Ghosh, Rahul
Khandelwal, Ankush
Jia, Xiaowei
Mulla, David
Kumar, Vipin
contents Accurate and timely crop mapping is essential for yield estimation, insurance claims, and conservation efforts. Over the years, many successful machine learning models for crop mapping have been developed that use just the multi-spectral imagery from satellites to predict crop type over the area of interest. However, these traditional methods do not account for the physical processes that govern crop growth. At a high level, crop growth can be envisioned as physical parameters, such as weather and soil type, acting upon the plant leading to crop growth which can be observed via satellites. In this paper, we propose Weather-based Spatio-Temporal segmentation network with ATTention (WSTATT), a deep learning model that leverages this understanding of crop growth by formulating it as an inverse model that combines weather (Daymet) and satellite imagery (Sentinel-2) to generate accurate crop maps. We show that our approach provides significant improvements over existing algorithms that solely rely on spectral imagery by comparing segmentation maps and F1 classification scores. Furthermore, effective use of attention in WSTATT architecture enables detection of crop types earlier in the season (up to 5 months in advance), which is very useful for improving food supply projections. We finally discuss the impact of weather by correlating our results with crop phenology to show that WSTATT is able to capture physical properties of crop growth.
format Preprint
id arxiv_https___arxiv_org_abs_2401_15875
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Combining Satellite and Weather Data for Crop Type Mapping: An Inverse Modelling Approach
Ravirathinam, Praveen
Ghosh, Rahul
Khandelwal, Ankush
Jia, Xiaowei
Mulla, David
Kumar, Vipin
Computer Vision and Pattern Recognition
Accurate and timely crop mapping is essential for yield estimation, insurance claims, and conservation efforts. Over the years, many successful machine learning models for crop mapping have been developed that use just the multi-spectral imagery from satellites to predict crop type over the area of interest. However, these traditional methods do not account for the physical processes that govern crop growth. At a high level, crop growth can be envisioned as physical parameters, such as weather and soil type, acting upon the plant leading to crop growth which can be observed via satellites. In this paper, we propose Weather-based Spatio-Temporal segmentation network with ATTention (WSTATT), a deep learning model that leverages this understanding of crop growth by formulating it as an inverse model that combines weather (Daymet) and satellite imagery (Sentinel-2) to generate accurate crop maps. We show that our approach provides significant improvements over existing algorithms that solely rely on spectral imagery by comparing segmentation maps and F1 classification scores. Furthermore, effective use of attention in WSTATT architecture enables detection of crop types earlier in the season (up to 5 months in advance), which is very useful for improving food supply projections. We finally discuss the impact of weather by correlating our results with crop phenology to show that WSTATT is able to capture physical properties of crop growth.
title Combining Satellite and Weather Data for Crop Type Mapping: An Inverse Modelling Approach
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2401.15875