Machine Learning Techniques for Data Reduction of Climate Applications
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916232026914816 |
|---|---|
| author | Li, Xiao Gong, Qian Lee, Jaemoon Klasky, Scott Rangarajan, Anand Ranka, Sanjay |
| author_facet | Li, Xiao Gong, Qian Lee, Jaemoon Klasky, Scott Rangarajan, Anand Ranka, Sanjay |
| contents | Scientists conduct large-scale simulations to compute derived quantities-of-interest (QoI) from primary data. Often, QoI are linked to specific features, regions, or time intervals, such that data can be adaptively reduced without compromising the integrity of QoI. For many spatiotemporal applications, these QoI are binary in nature and represent presence or absence of a physical phenomenon. We present a pipelined compression approach that first uses neural-network-based techniques to derive regions where QoI are highly likely to be present. Then, we employ a Guaranteed Autoencoder (GAE) to compress data with differential error bounds. GAE uses QoI information to apply low-error compression to only these regions. This results in overall high compression ratios while still achieving downstream goals of simulation or data collections. Experimental results are presented for climate data generated from the E3SM Simulation model for downstream quantities such as tropical cyclone and atmospheric river detection and tracking. These results show that our approach is superior to comparable methods in the literature. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_00879 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Machine Learning Techniques for Data Reduction of Climate Applications Li, Xiao Gong, Qian Lee, Jaemoon Klasky, Scott Rangarajan, Anand Ranka, Sanjay Machine Learning Atmospheric and Oceanic Physics Scientists conduct large-scale simulations to compute derived quantities-of-interest (QoI) from primary data. Often, QoI are linked to specific features, regions, or time intervals, such that data can be adaptively reduced without compromising the integrity of QoI. For many spatiotemporal applications, these QoI are binary in nature and represent presence or absence of a physical phenomenon. We present a pipelined compression approach that first uses neural-network-based techniques to derive regions where QoI are highly likely to be present. Then, we employ a Guaranteed Autoencoder (GAE) to compress data with differential error bounds. GAE uses QoI information to apply low-error compression to only these regions. This results in overall high compression ratios while still achieving downstream goals of simulation or data collections. Experimental results are presented for climate data generated from the E3SM Simulation model for downstream quantities such as tropical cyclone and atmospheric river detection and tracking. These results show that our approach is superior to comparable methods in the literature. |
| title | Machine Learning Techniques for Data Reduction of Climate Applications |
| topic | Machine Learning Atmospheric and Oceanic Physics |
| url | https://arxiv.org/abs/2405.00879 |