STLDM: Spatio-Temporal Latent Diffusion Model for Precipitation Nowcasting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Foo, Shi Quan, Wong, Chi-Ho, Gao, Zhihan, Yeung, Dit-Yan, Wong, Ka-Hing, Wong, Wai-Kin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909975399366656
author Foo, Shi Quan
Wong, Chi-Ho
Gao, Zhihan
Yeung, Dit-Yan
Wong, Ka-Hing
Wong, Wai-Kin
author_facet Foo, Shi Quan
Wong, Chi-Ho
Gao, Zhihan
Yeung, Dit-Yan
Wong, Ka-Hing
Wong, Wai-Kin
contents Precipitation nowcasting is a critical spatio-temporal prediction task for society to prevent severe damage owing to extreme weather events. Despite the advances in this field, the complex and stochastic nature of this task still poses challenges to existing approaches. Specifically, deterministic models tend to produce blurry predictions while generative models often struggle with poor accuracy. In this paper, we present a simple yet effective model architecture termed STLDM, a diffusion-based model that learns the latent representation from end to end alongside both the Variational Autoencoder and the conditioning network. STLDM decomposes this task into two stages: a deterministic forecasting stage handled by the conditioning network, and an enhancement stage performed by the latent diffusion model. Experimental results on multiple radar datasets demonstrate that STLDM achieves superior performance compared to the state of the art, while also improving inference efficiency. The code is available in https://github.com/sqfoo/stldm_official.
format Preprint
id arxiv_https___arxiv_org_abs_2512_21118
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle STLDM: Spatio-Temporal Latent Diffusion Model for Precipitation Nowcasting
Foo, Shi Quan
Wong, Chi-Ho
Gao, Zhihan
Yeung, Dit-Yan
Wong, Ka-Hing
Wong, Wai-Kin
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Precipitation nowcasting is a critical spatio-temporal prediction task for society to prevent severe damage owing to extreme weather events. Despite the advances in this field, the complex and stochastic nature of this task still poses challenges to existing approaches. Specifically, deterministic models tend to produce blurry predictions while generative models often struggle with poor accuracy. In this paper, we present a simple yet effective model architecture termed STLDM, a diffusion-based model that learns the latent representation from end to end alongside both the Variational Autoencoder and the conditioning network. STLDM decomposes this task into two stages: a deterministic forecasting stage handled by the conditioning network, and an enhancement stage performed by the latent diffusion model. Experimental results on multiple radar datasets demonstrate that STLDM achieves superior performance compared to the state of the art, while also improving inference efficiency. The code is available in https://github.com/sqfoo/stldm_official.
title STLDM: Spatio-Temporal Latent Diffusion Model for Precipitation Nowcasting
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.21118