WxC-Bench: A Novel Dataset for Weather and Climate Downstream Tasks
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912143245312000 |
|---|---|
| author | Shinde, Rajat Phillips, Christopher E. Ankur, Kumar Gupta, Aman Pfreundschuh, Simon Roy, Sujit Kirkland, Sheyenne Gaur, Vishal Lin, Amy Sheshadri, Aditi Nair, Udaysankar Maskey, Manil Ramachandran, Rahul |
| author_facet | Shinde, Rajat Phillips, Christopher E. Ankur, Kumar Gupta, Aman Pfreundschuh, Simon Roy, Sujit Kirkland, Sheyenne Gaur, Vishal Lin, Amy Sheshadri, Aditi Nair, Udaysankar Maskey, Manil Ramachandran, Rahul |
| contents | High-quality machine learning (ML)-ready datasets play a foundational role in developing new artificial intelligence (AI) models or fine-tuning existing models for scientific applications such as weather and climate analysis. Unfortunately, despite the growing development of new deep learning models for weather and climate, there is a scarcity of curated, pre-processed machine learning (ML)-ready datasets. Curating such high-quality datasets for developing new models is challenging particularly because the modality of the input data varies significantly for different downstream tasks addressing different atmospheric scales (spatial and temporal). Here we introduce WxC-Bench (Weather and Climate Bench), a multi-modal dataset designed to support the development of generalizable AI models for downstream use-cases in weather and climate research. WxC-Bench is designed as a dataset of datasets for developing ML-models for a complex weather and climate system, addressing selected downstream tasks as machine learning phenomenon. WxC-Bench encompasses several atmospheric processes from meso-$β$ (20 - 200 km) scale to synoptic scales (2500 km), such as aviation turbulence, hurricane intensity and track monitoring, weather analog search, gravity wave parameterization, and natural language report generation. We provide a comprehensive description of the dataset and also present a technical validation for baseline analysis. The dataset and code to prepare the ML-ready data have been made publicly available on Hugging Face -- https://huggingface.co/datasets/nasa-impact/WxC-Bench |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_02780 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | WxC-Bench: A Novel Dataset for Weather and Climate Downstream Tasks Shinde, Rajat Phillips, Christopher E. Ankur, Kumar Gupta, Aman Pfreundschuh, Simon Roy, Sujit Kirkland, Sheyenne Gaur, Vishal Lin, Amy Sheshadri, Aditi Nair, Udaysankar Maskey, Manil Ramachandran, Rahul Machine Learning Artificial Intelligence High-quality machine learning (ML)-ready datasets play a foundational role in developing new artificial intelligence (AI) models or fine-tuning existing models for scientific applications such as weather and climate analysis. Unfortunately, despite the growing development of new deep learning models for weather and climate, there is a scarcity of curated, pre-processed machine learning (ML)-ready datasets. Curating such high-quality datasets for developing new models is challenging particularly because the modality of the input data varies significantly for different downstream tasks addressing different atmospheric scales (spatial and temporal). Here we introduce WxC-Bench (Weather and Climate Bench), a multi-modal dataset designed to support the development of generalizable AI models for downstream use-cases in weather and climate research. WxC-Bench is designed as a dataset of datasets for developing ML-models for a complex weather and climate system, addressing selected downstream tasks as machine learning phenomenon. WxC-Bench encompasses several atmospheric processes from meso-$β$ (20 - 200 km) scale to synoptic scales (2500 km), such as aviation turbulence, hurricane intensity and track monitoring, weather analog search, gravity wave parameterization, and natural language report generation. We provide a comprehensive description of the dataset and also present a technical validation for baseline analysis. The dataset and code to prepare the ML-ready data have been made publicly available on Hugging Face -- https://huggingface.co/datasets/nasa-impact/WxC-Bench |
| title | WxC-Bench: A Novel Dataset for Weather and Climate Downstream Tasks |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2412.02780 |