Kilometer-Level Coupled Modeling Using 40 Million Cores: An Eight-Year Journey of Model Development

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Duan, Xiaohui, Li, Yuxuan, Liu, Zhao, Yang, Bin, Zheng, Juepeng, Fu, Haohuan, Zhang, Shaoqing, Xu, Shiming, Gao, Yang, Xue, Wei, Wei, Di, Lv, Xiaojing, Yan, Lifeng, Huang, Haopeng, Lu, Haitian, Wan, Lingfeng, Lin, Haoran, Chang, Qixin, Li, Chenlin, He, Quanjie, Song, Zeyu, Wang, Xuantong, Yu, Yangyang, Fan, Xilong, Qu, Zhaopeng, Xu, Yankun, Guo, Xiuwen, Fei, Yunlong, Wang, Zhaoying, Li, Mingkui, Jiang, Yingjing, Lu, Lv, Su, Liang, Fu, Jiayu, Yu, Peinan, Liu, Weiguo, Wu, Lixin, Wang, Lanning, Liu, Xin, Chen, Dexun, Yang, Guangwen
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929315451502592
author Duan, Xiaohui
Li, Yuxuan
Liu, Zhao
Yang, Bin
Zheng, Juepeng
Fu, Haohuan
Zhang, Shaoqing
Xu, Shiming
Gao, Yang
Xue, Wei
Wei, Di
Lv, Xiaojing
Yan, Lifeng
Huang, Haopeng
Lu, Haitian
Wan, Lingfeng
Lin, Haoran
Chang, Qixin
Li, Chenlin
He, Quanjie
Song, Zeyu
Wang, Xuantong
Yu, Yangyang
Fan, Xilong
Qu, Zhaopeng
Xu, Yankun
Guo, Xiuwen
Fei, Yunlong
Wang, Zhaoying
Li, Mingkui
Jiang, Yingjing
Lu, Lv
Su, Liang
Fu, Jiayu
Yu, Peinan
Liu, Weiguo
Wu, Lixin
Wang, Lanning
Liu, Xin
Chen, Dexun
Yang, Guangwen
author_facet Duan, Xiaohui
Li, Yuxuan
Liu, Zhao
Yang, Bin
Zheng, Juepeng
Fu, Haohuan
Zhang, Shaoqing
Xu, Shiming
Gao, Yang
Xue, Wei
Wei, Di
Lv, Xiaojing
Yan, Lifeng
Huang, Haopeng
Lu, Haitian
Wan, Lingfeng
Lin, Haoran
Chang, Qixin
Li, Chenlin
He, Quanjie
Song, Zeyu
Wang, Xuantong
Yu, Yangyang
Fan, Xilong
Qu, Zhaopeng
Xu, Yankun
Guo, Xiuwen
Fei, Yunlong
Wang, Zhaoying
Li, Mingkui
Jiang, Yingjing
Lu, Lv
Su, Liang
Fu, Jiayu
Yu, Peinan
Liu, Weiguo
Wu, Lixin
Wang, Lanning
Liu, Xin
Chen, Dexun
Yang, Guangwen
contents With current and future leading systems adopting heterogeneous architectures, adapting existing models for heterogeneous supercomputers is of urgent need for improving model resolution and reducing modeling uncertainty. This paper presents our three-week effort on porting a complex earth system model, CESM 2.2, to a 40-million-core Sunway supercomputer. Taking a non-intrusive approach that tries to minimizes manual code modifications, our project tries to achieve both improvement of performance and consistency of the model code. By using a hierarchical grid system and an OpenMP-based offloading toolkit, our porting and parallelization effort covers over 80% of the code, and achieves a simulation speed of 340 SDPD (simulated days per day) for 5-km atmosphere, 265 SDPD for 3-km ocean, and 222 SDPD for a coupled model, thus making multi-year or even multi-decadal experiments at such high resolution possible.
format Preprint
id arxiv_https___arxiv_org_abs_2404_10253
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Kilometer-Level Coupled Modeling Using 40 Million Cores: An Eight-Year Journey of Model Development
Duan, Xiaohui
Li, Yuxuan
Liu, Zhao
Yang, Bin
Zheng, Juepeng
Fu, Haohuan
Zhang, Shaoqing
Xu, Shiming
Gao, Yang
Xue, Wei
Wei, Di
Lv, Xiaojing
Yan, Lifeng
Huang, Haopeng
Lu, Haitian
Wan, Lingfeng
Lin, Haoran
Chang, Qixin
Li, Chenlin
He, Quanjie
Song, Zeyu
Wang, Xuantong
Yu, Yangyang
Fan, Xilong
Qu, Zhaopeng
Xu, Yankun
Guo, Xiuwen
Fei, Yunlong
Wang, Zhaoying
Li, Mingkui
Jiang, Yingjing
Lu, Lv
Su, Liang
Fu, Jiayu
Yu, Peinan
Liu, Weiguo
Wu, Lixin
Wang, Lanning
Liu, Xin
Chen, Dexun
Yang, Guangwen
Distributed, Parallel, and Cluster Computing
With current and future leading systems adopting heterogeneous architectures, adapting existing models for heterogeneous supercomputers is of urgent need for improving model resolution and reducing modeling uncertainty. This paper presents our three-week effort on porting a complex earth system model, CESM 2.2, to a 40-million-core Sunway supercomputer. Taking a non-intrusive approach that tries to minimizes manual code modifications, our project tries to achieve both improvement of performance and consistency of the model code. By using a hierarchical grid system and an OpenMP-based offloading toolkit, our porting and parallelization effort covers over 80% of the code, and achieves a simulation speed of 340 SDPD (simulated days per day) for 5-km atmosphere, 265 SDPD for 3-km ocean, and 222 SDPD for a coupled model, thus making multi-year or even multi-decadal experiments at such high resolution possible.
title Kilometer-Level Coupled Modeling Using 40 Million Cores: An Eight-Year Journey of Model Development
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2404.10253