Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operators

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mahesh, Ankur, Collins, William, Bonev, Boris, Brenowitz, Noah, Cohen, Yair, Harrington, Peter, Kashinath, Karthik, Kurth, Thorsten, North, Joshua, OBrien, Travis, Pritchard, Michael, Pruitt, David, Risser, Mark, Subramanian, Shashank, Willard, Jared
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866916672298811392
author Mahesh, Ankur
Collins, William
Bonev, Boris
Brenowitz, Noah
Cohen, Yair
Harrington, Peter
Kashinath, Karthik
Kurth, Thorsten
North, Joshua
OBrien, Travis
Pritchard, Michael
Pruitt, David
Risser, Mark
Subramanian, Shashank
Willard, Jared
author_facet Mahesh, Ankur
Collins, William
Bonev, Boris
Brenowitz, Noah
Cohen, Yair
Harrington, Peter
Kashinath, Karthik
Kurth, Thorsten
North, Joshua
OBrien, Travis
Pritchard, Michael
Pruitt, David
Risser, Mark
Subramanian, Shashank
Willard, Jared
contents In Part I, we created an ensemble based on Spherical Fourier Neural Operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multiple checkpoints trained independently from scratch. Based on diagnostics that assess the ensemble's physical fidelity, our ensemble has comparable performance to operational weather forecasting systems. However, it requires orders of magnitude fewer computational resources. Here in Part II, we generate a huge ensemble (HENS), with 7,424 members initialized each day of summer 2023. We enumerate the technical requirements for running huge ensembles at this scale. HENS precisely samples the tails of the forecast distribution and presents a detailed sampling of internal variability. HENS has two primary applications: (1) as a large dataset with which to study the statistics and drivers of extreme weather and (2) as a weather forecasting system. For extreme climate statistics, HENS samples events 4$σ$ away from the ensemble mean. At each grid cell, HENS increases the skill of the most accurate ensemble member and enhances coverage of possible future trajectories. As a weather forecasting model, HENS issues extreme weather forecasts with better uncertainty quantification. It also reduces the probability of outlier events, in which the verification value lies outside the ensemble forecast distribution.
format Preprint
id arxiv_https___arxiv_org_abs_2408_01581
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operators
Mahesh, Ankur
Collins, William
Bonev, Boris
Brenowitz, Noah
Cohen, Yair
Harrington, Peter
Kashinath, Karthik
Kurth, Thorsten
North, Joshua
OBrien, Travis
Pritchard, Michael
Pruitt, David
Risser, Mark
Subramanian, Shashank
Willard, Jared
Machine Learning
Atmospheric and Oceanic Physics
In Part I, we created an ensemble based on Spherical Fourier Neural Operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multiple checkpoints trained independently from scratch. Based on diagnostics that assess the ensemble's physical fidelity, our ensemble has comparable performance to operational weather forecasting systems. However, it requires orders of magnitude fewer computational resources. Here in Part II, we generate a huge ensemble (HENS), with 7,424 members initialized each day of summer 2023. We enumerate the technical requirements for running huge ensembles at this scale. HENS precisely samples the tails of the forecast distribution and presents a detailed sampling of internal variability. HENS has two primary applications: (1) as a large dataset with which to study the statistics and drivers of extreme weather and (2) as a weather forecasting system. For extreme climate statistics, HENS samples events 4$σ$ away from the ensemble mean. At each grid cell, HENS increases the skill of the most accurate ensemble member and enhances coverage of possible future trajectories. As a weather forecasting model, HENS issues extreme weather forecasts with better uncertainty quantification. It also reduces the probability of outlier events, in which the verification value lies outside the ensemble forecast distribution.
title Huge Ensembles Part II: Properties of a Huge Ensemble of Hindcasts Generated with Spherical Fourier Neural Operators
topic Machine Learning
Atmospheric and Oceanic Physics
url https://arxiv.org/abs/2408.01581