Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Rui, Meng, Qi, Zhu, Rongchan, Wang, Yue, Shi, Wenlei, Zhang, Shihua, Ma, Zhi-Ming, Liu, Tie-Yan
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866910868290142208
author Zhang, Rui
Meng, Qi
Zhu, Rongchan
Wang, Yue
Shi, Wenlei
Zhang, Shihua
Ma, Zhi-Ming
Liu, Tie-Yan
author_facet Zhang, Rui
Meng, Qi
Zhu, Rongchan
Wang, Yue
Shi, Wenlei
Zhang, Shihua
Ma, Zhi-Ming
Liu, Tie-Yan
contents In scenarios with limited available data, training the function-to-function neural PDE solver in an unsupervised manner is essential. However, the efficiency and accuracy of existing methods are constrained by the properties of numerical algorithms, such as finite difference and pseudo-spectral methods, integrated during the training stage. These methods necessitate careful spatiotemporal discretization to achieve reasonable accuracy, leading to significant computational challenges and inaccurate simulations, particularly in cases with substantial spatiotemporal variations. To address these limitations, we propose the Monte Carlo Neural PDE Solver (MCNP Solver) for training unsupervised neural solvers via the PDEs' probabilistic representation, which regards macroscopic phenomena as ensembles of random particles. Compared to other unsupervised methods, MCNP Solver naturally inherits the advantages of the Monte Carlo method, which is robust against spatiotemporal variations and can tolerate coarse step size. In simulating the trajectories of particles, we employ Heun's method for the convection process and calculate the expectation via the probability density function of neighbouring grid points during the diffusion process. These techniques enhance accuracy and circumvent the computational issues associated with Monte Carlo sampling. Our numerical experiments on convection-diffusion, Allen-Cahn, and Navier-Stokes equations demonstrate significant improvements in accuracy and efficiency compared to other unsupervised baselines. The source code will be publicly available at: https://github.com/optray/MCNP.
format Preprint
id arxiv_https___arxiv_org_abs_2302_05104
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation
Zhang, Rui
Meng, Qi
Zhu, Rongchan
Wang, Yue
Shi, Wenlei
Zhang, Shihua
Ma, Zhi-Ming
Liu, Tie-Yan
Machine Learning
Numerical Analysis
Probability
In scenarios with limited available data, training the function-to-function neural PDE solver in an unsupervised manner is essential. However, the efficiency and accuracy of existing methods are constrained by the properties of numerical algorithms, such as finite difference and pseudo-spectral methods, integrated during the training stage. These methods necessitate careful spatiotemporal discretization to achieve reasonable accuracy, leading to significant computational challenges and inaccurate simulations, particularly in cases with substantial spatiotemporal variations. To address these limitations, we propose the Monte Carlo Neural PDE Solver (MCNP Solver) for training unsupervised neural solvers via the PDEs' probabilistic representation, which regards macroscopic phenomena as ensembles of random particles. Compared to other unsupervised methods, MCNP Solver naturally inherits the advantages of the Monte Carlo method, which is robust against spatiotemporal variations and can tolerate coarse step size. In simulating the trajectories of particles, we employ Heun's method for the convection process and calculate the expectation via the probability density function of neighbouring grid points during the diffusion process. These techniques enhance accuracy and circumvent the computational issues associated with Monte Carlo sampling. Our numerical experiments on convection-diffusion, Allen-Cahn, and Navier-Stokes equations demonstrate significant improvements in accuracy and efficiency compared to other unsupervised baselines. The source code will be publicly available at: https://github.com/optray/MCNP.
title Monte Carlo Neural PDE Solver for Learning PDEs via Probabilistic Representation
topic Machine Learning
Numerical Analysis
Probability
url https://arxiv.org/abs/2302.05104