Assimilating Observed Surface Pressure into ML Weather Prediction Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Slivinski, Laura C., Whitaker, Jeffrey S., Frolov, Sergey, Smith, Timothy A., Agarwal, Niraj
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912168808546304
author Slivinski, Laura C.
Whitaker, Jeffrey S.
Frolov, Sergey
Smith, Timothy A.
Agarwal, Niraj
author_facet Slivinski, Laura C.
Whitaker, Jeffrey S.
Frolov, Sergey
Smith, Timothy A.
Agarwal, Niraj
contents There has been a recent surge in development of accurate machine learning (ML) weather prediction models, but evaluation of these models has mainly been focused on medium-range forecasts, not their performance in cycling data assimilation (DA) systems. Cycling DA provides a statistically optimal estimate of model initial conditions, given observations and previous model forecasts. Here, real surface pressure observations are assimilated into several popular ML models using an ensemble Kalman filter, where accurate ensemble covariance estimation is essential to constrain unobserved state variables from sparse observations. In this cycling DA system, deterministic ML models accumulate small-scale noise until they diverge. Mitigating this noise with a spectral filter can stabilize the system, but with larger errors than traditional models. Perturbation experiments illustrate that these models do not accurately represent short-term error growth, leading to poor estimation of cross-variable covariances.
format Preprint
id arxiv_https___arxiv_org_abs_2412_18016
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Assimilating Observed Surface Pressure into ML Weather Prediction Models
Slivinski, Laura C.
Whitaker, Jeffrey S.
Frolov, Sergey
Smith, Timothy A.
Agarwal, Niraj
Atmospheric and Oceanic Physics
There has been a recent surge in development of accurate machine learning (ML) weather prediction models, but evaluation of these models has mainly been focused on medium-range forecasts, not their performance in cycling data assimilation (DA) systems. Cycling DA provides a statistically optimal estimate of model initial conditions, given observations and previous model forecasts. Here, real surface pressure observations are assimilated into several popular ML models using an ensemble Kalman filter, where accurate ensemble covariance estimation is essential to constrain unobserved state variables from sparse observations. In this cycling DA system, deterministic ML models accumulate small-scale noise until they diverge. Mitigating this noise with a spectral filter can stabilize the system, but with larger errors than traditional models. Perturbation experiments illustrate that these models do not accurately represent short-term error growth, leading to poor estimation of cross-variable covariances.
title Assimilating Observed Surface Pressure into ML Weather Prediction Models
topic Atmospheric and Oceanic Physics
url https://arxiv.org/abs/2412.18016