ADAF: An Artificial Intelligence Data Assimilation Framework for Weather Forecasting

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xiang, Yanfei, Jin, Weixin, Dong, Haiyu, Bai, Mingliang, Fang, Zuliang, Zhao, Pengcheng, Sun, Hongyu, Thambiratnam, Kit, Zhang, Qi, Huang, Xiaomeng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909405294886912
author Xiang, Yanfei
Jin, Weixin
Dong, Haiyu
Bai, Mingliang
Fang, Zuliang
Zhao, Pengcheng
Sun, Hongyu
Thambiratnam, Kit
Zhang, Qi
Huang, Xiaomeng
author_facet Xiang, Yanfei
Jin, Weixin
Dong, Haiyu
Bai, Mingliang
Fang, Zuliang
Zhao, Pengcheng
Sun, Hongyu
Thambiratnam, Kit
Zhang, Qi
Huang, Xiaomeng
contents The forecasting skill of numerical weather prediction (NWP) models critically depends on the accurate initial conditions, also known as analysis, provided by data assimilation (DA). Traditional DA methods often face a trade-off between computational cost and accuracy due to complex linear algebra computations and the high dimensionality of the model, especially in nonlinear systems. Moreover, processing massive data in real-time requires substantial computational resources. To address this, we introduce an artificial intelligence-based data assimilation framework (ADAF) to generate high-quality kilometer-scale analysis. This study is the pioneering work using real-world observations from varied locations and multiple sources to verify the AI method's efficacy in DA, including sparse surface weather observations and satellite imagery. We implemented ADAF for four near-surface variables in the Contiguous United States (CONUS). The results indicate that ADAF surpasses the High Resolution Rapid Refresh Data Assimilation System (HRRRDAS) in accuracy by 16% to 33% for near-surface atmospheric conditions, aligning more closely with actual observations, and can effectively reconstruct extreme events, such as tropical cyclone wind fields. Sensitivity experiments reveal that ADAF can generate high-quality analysis even with low-accuracy backgrounds and extremely sparse surface observations. ADAF can assimilate massive observations within a three-hour window at low computational cost, taking about two seconds on an AMD MI200 graphics processing unit (GPU). ADAF has been shown to be efficient and effective in real-world DA, underscoring its potential role in operational weather forecasting.
format Preprint
id arxiv_https___arxiv_org_abs_2411_16807
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ADAF: An Artificial Intelligence Data Assimilation Framework for Weather Forecasting
Xiang, Yanfei
Jin, Weixin
Dong, Haiyu
Bai, Mingliang
Fang, Zuliang
Zhao, Pengcheng
Sun, Hongyu
Thambiratnam, Kit
Zhang, Qi
Huang, Xiaomeng
Atmospheric and Oceanic Physics
Artificial Intelligence
Machine Learning
The forecasting skill of numerical weather prediction (NWP) models critically depends on the accurate initial conditions, also known as analysis, provided by data assimilation (DA). Traditional DA methods often face a trade-off between computational cost and accuracy due to complex linear algebra computations and the high dimensionality of the model, especially in nonlinear systems. Moreover, processing massive data in real-time requires substantial computational resources. To address this, we introduce an artificial intelligence-based data assimilation framework (ADAF) to generate high-quality kilometer-scale analysis. This study is the pioneering work using real-world observations from varied locations and multiple sources to verify the AI method's efficacy in DA, including sparse surface weather observations and satellite imagery. We implemented ADAF for four near-surface variables in the Contiguous United States (CONUS). The results indicate that ADAF surpasses the High Resolution Rapid Refresh Data Assimilation System (HRRRDAS) in accuracy by 16% to 33% for near-surface atmospheric conditions, aligning more closely with actual observations, and can effectively reconstruct extreme events, such as tropical cyclone wind fields. Sensitivity experiments reveal that ADAF can generate high-quality analysis even with low-accuracy backgrounds and extremely sparse surface observations. ADAF can assimilate massive observations within a three-hour window at low computational cost, taking about two seconds on an AMD MI200 graphics processing unit (GPU). ADAF has been shown to be efficient and effective in real-world DA, underscoring its potential role in operational weather forecasting.
title ADAF: An Artificial Intelligence Data Assimilation Framework for Weather Forecasting
topic Atmospheric and Oceanic Physics
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2411.16807