WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915054513815552 |
|---|---|
| author | Zhao, Xiangyu Zhou, Zhiwang Zhang, Wenlong Liu, Yihao Chen, Xiangyu Gong, Junchao Chen, Hao Fei, Ben Chen, Shiqi Ouyang, Wanli Wu, Xiao-Ming Bai, Lei |
| author_facet | Zhao, Xiangyu Zhou, Zhiwang Zhang, Wenlong Liu, Yihao Chen, Xiangyu Gong, Junchao Chen, Hao Fei, Ben Chen, Shiqi Ouyang, Wanli Wu, Xiao-Ming Bai, Lei |
| contents | The Earth's weather system encompasses intricate weather data modalities and diverse weather understanding tasks, which hold significant value to human life. Existing data-driven models focus on single weather understanding tasks (e.g., weather forecasting). Although these models have achieved promising results, they fail to tackle various complex tasks within a single and unified model. Moreover, the paradigm that relies on limited real observations for a single scenario hinders the model's performance upper bound. In response to these limitations, we draw inspiration from the in-context learning paradigm employed in state-of-the-art visual foundation models and large language models. In this paper, we introduce the first generalist weather foundation model (WeatherGFM), designed to address a wide spectrum of weather understanding tasks in a unified manner. More specifically, we initially unify the representation and definition of the diverse weather understanding tasks. Subsequently, we devised weather prompt formats to manage different weather data modalities, namely single, multiple, and temporal modalities. Finally, we adopt a visual prompting question-answering paradigm for the training of unified weather understanding tasks. Extensive experiments indicate that our WeatherGFM can effectively handle up to ten weather understanding tasks, including weather forecasting, super-resolution, weather image translation, and post-processing. Our method also showcases generalization ability on unseen tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_05420 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learning Zhao, Xiangyu Zhou, Zhiwang Zhang, Wenlong Liu, Yihao Chen, Xiangyu Gong, Junchao Chen, Hao Fei, Ben Chen, Shiqi Ouyang, Wanli Wu, Xiao-Ming Bai, Lei Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition Atmospheric and Oceanic Physics The Earth's weather system encompasses intricate weather data modalities and diverse weather understanding tasks, which hold significant value to human life. Existing data-driven models focus on single weather understanding tasks (e.g., weather forecasting). Although these models have achieved promising results, they fail to tackle various complex tasks within a single and unified model. Moreover, the paradigm that relies on limited real observations for a single scenario hinders the model's performance upper bound. In response to these limitations, we draw inspiration from the in-context learning paradigm employed in state-of-the-art visual foundation models and large language models. In this paper, we introduce the first generalist weather foundation model (WeatherGFM), designed to address a wide spectrum of weather understanding tasks in a unified manner. More specifically, we initially unify the representation and definition of the diverse weather understanding tasks. Subsequently, we devised weather prompt formats to manage different weather data modalities, namely single, multiple, and temporal modalities. Finally, we adopt a visual prompting question-answering paradigm for the training of unified weather understanding tasks. Extensive experiments indicate that our WeatherGFM can effectively handle up to ten weather understanding tasks, including weather forecasting, super-resolution, weather image translation, and post-processing. Our method also showcases generalization ability on unseen tasks. |
| title | WeatherGFM: Learning A Weather Generalist Foundation Model via In-context Learning |
| topic | Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition Atmospheric and Oceanic Physics |
| url | https://arxiv.org/abs/2411.05420 |