Recommendations for Comprehensive and Independent Evaluation of Machine Learning-Based Earth System Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ullrich, Paul A., Barnes, Elizabeth A., Collins, William D., Dagon, Katherine, Duan, Shiheng, Elms, Joshua, Lee, Jiwoo, Leung, L. Ruby, Lu, Dan, Molina, Maria J., O'Brien, Travis A., Rebassoo, Finn O.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917885128998912
author Ullrich, Paul A.
Barnes, Elizabeth A.
Collins, William D.
Dagon, Katherine
Duan, Shiheng
Elms, Joshua
Lee, Jiwoo
Leung, L. Ruby
Lu, Dan
Molina, Maria J.
O'Brien, Travis A.
Rebassoo, Finn O.
author_facet Ullrich, Paul A.
Barnes, Elizabeth A.
Collins, William D.
Dagon, Katherine
Duan, Shiheng
Elms, Joshua
Lee, Jiwoo
Leung, L. Ruby
Lu, Dan
Molina, Maria J.
O'Brien, Travis A.
Rebassoo, Finn O.
contents Machine learning (ML) is a revolutionary technology with demonstrable applications across multiple disciplines. Within the Earth science community, ML has been most visible for weather forecasting, producing forecasts that rival modern physics-based models. Given the importance of deepening our understanding and improving predictions of the Earth system on all time scales, efforts are now underway to develop forecasting models into Earth-system models (ESMs), capable of representing all components of the coupled Earth system (or their aggregated behavior) and their response to external changes. Modeling the Earth system is a much more difficult problem than weather forecasting, not least because the model must represent the alternate (e.g., future) coupled states of the system for which there are no historical observations. Given that the physical principles that enable predictions about the response of the Earth system are often not explicitly coded in these ML-based models, demonstrating the credibility of ML-based ESMs thus requires us to build evidence of their consistency with the physical system. To this end, this paper puts forward five recommendations to enhance comprehensive, standardized, and independent evaluation of ML-based ESMs to strengthen their credibility and promote their wider use.
format Preprint
id arxiv_https___arxiv_org_abs_2410_19882
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Recommendations for Comprehensive and Independent Evaluation of Machine Learning-Based Earth System Models
Ullrich, Paul A.
Barnes, Elizabeth A.
Collins, William D.
Dagon, Katherine
Duan, Shiheng
Elms, Joshua
Lee, Jiwoo
Leung, L. Ruby
Lu, Dan
Molina, Maria J.
O'Brien, Travis A.
Rebassoo, Finn O.
Machine Learning
Atmospheric and Oceanic Physics
Machine learning (ML) is a revolutionary technology with demonstrable applications across multiple disciplines. Within the Earth science community, ML has been most visible for weather forecasting, producing forecasts that rival modern physics-based models. Given the importance of deepening our understanding and improving predictions of the Earth system on all time scales, efforts are now underway to develop forecasting models into Earth-system models (ESMs), capable of representing all components of the coupled Earth system (or their aggregated behavior) and their response to external changes. Modeling the Earth system is a much more difficult problem than weather forecasting, not least because the model must represent the alternate (e.g., future) coupled states of the system for which there are no historical observations. Given that the physical principles that enable predictions about the response of the Earth system are often not explicitly coded in these ML-based models, demonstrating the credibility of ML-based ESMs thus requires us to build evidence of their consistency with the physical system. To this end, this paper puts forward five recommendations to enhance comprehensive, standardized, and independent evaluation of ML-based ESMs to strengthen their credibility and promote their wider use.
title Recommendations for Comprehensive and Independent Evaluation of Machine Learning-Based Earth System Models
topic Machine Learning
Atmospheric and Oceanic Physics
url https://arxiv.org/abs/2410.19882