Saved in:
Bibliographic Details
Main Authors: Mazumder, Swaib Ilias, Kumar, Manish, Khan, Aparajita
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.23267
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908562738905088
author Mazumder, Swaib Ilias
Kumar, Manish
Khan, Aparajita
author_facet Mazumder, Swaib Ilias
Kumar, Manish
Khan, Aparajita
contents Accurate monsoon rainfall prediction is vital for India's agriculture, water management, and climate risk planning, yet remains challenging due to sparse ground observations and complex regional variability. We present a multimodal deep learning framework for high-resolution precipitation classification that leverages satellite and Earth observation data. Unlike previous rainfall prediction models based on coarse 5-50 km grids, we curate a new 1 km resolution dataset for five Indian states, integrating seven key geospatial modalities: land surface temperature, vegetation (NDVI), soil moisture, relative humidity, wind speed, elevation, and land use, covering the June-September 2024 monsoon season. Our approach uses an attention-guided U-Net architecture to capture spatial patterns and temporal dependencies across modalities, combined with focal and dice loss functions to handle rainfall class imbalance defined by the India Meteorological Department (IMD). Experiments demonstrate that our multimodal framework consistently outperforms unimodal baselines and existing deep learning methods, especially in extreme rainfall categories. This work contributes a scalable framework, benchmark dataset, and state-of-the-art results for regional monsoon forecasting, climate resilience, and geospatial AI applications in India.
format Preprint
id arxiv_https___arxiv_org_abs_2509_23267
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning Regional Monsoon Patterns with a Multimodal Attention U-Net
Mazumder, Swaib Ilias
Kumar, Manish
Khan, Aparajita
Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
Accurate monsoon rainfall prediction is vital for India's agriculture, water management, and climate risk planning, yet remains challenging due to sparse ground observations and complex regional variability. We present a multimodal deep learning framework for high-resolution precipitation classification that leverages satellite and Earth observation data. Unlike previous rainfall prediction models based on coarse 5-50 km grids, we curate a new 1 km resolution dataset for five Indian states, integrating seven key geospatial modalities: land surface temperature, vegetation (NDVI), soil moisture, relative humidity, wind speed, elevation, and land use, covering the June-September 2024 monsoon season. Our approach uses an attention-guided U-Net architecture to capture spatial patterns and temporal dependencies across modalities, combined with focal and dice loss functions to handle rainfall class imbalance defined by the India Meteorological Department (IMD). Experiments demonstrate that our multimodal framework consistently outperforms unimodal baselines and existing deep learning methods, especially in extreme rainfall categories. This work contributes a scalable framework, benchmark dataset, and state-of-the-art results for regional monsoon forecasting, climate resilience, and geospatial AI applications in India.
title Learning Regional Monsoon Patterns with a Multimodal Attention U-Net
topic Computer Vision and Pattern Recognition
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2509.23267