A Priori Error Estimation of Physics-Informed Neural Networks Solving Allen--Cahn and Cahn--Hilliard Equations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Guangtao, Lin, Jiani, Zhai, Qijia, Yang, Huiyu, Chen, Xujun, Leong, Ieng Tak, Zhu, Fang
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912923542093824
author Zhang, Guangtao
Lin, Jiani
Zhai, Qijia
Yang, Huiyu
Chen, Xujun
Leong, Ieng Tak
Zhu, Fang
author_facet Zhang, Guangtao
Lin, Jiani
Zhai, Qijia
Yang, Huiyu
Chen, Xujun
Leong, Ieng Tak
Zhu, Fang
contents Physics-Informed Neural Networks (PINNs) encounter accuracy limitations when solving the Allen--Cahn (AC) and Cahn--Hilliard (CH) partial differential equations (PDEs). To overcome this, we employ a novel loss function, Residuals-weighted Region Activation Evaluation (Residuals-RAE), featuring a { pre-training weight update scheme}. { Unlike conventional self-adaptive PINNs where weights evolve simultaneously with network parameters, Residuals-RAE-PINNs computes weights from current residuals before each training step and holds them constant during gradient updates. We establish weight convergence under standard neural network optimization assumptions, which justifies analyzing the converged network with constant weights.} Based on this theoretical framework, we derive the error estimation for PINNs with Residuals-RAE when solving AC and CH equations. {The analysis is aligned with Monte-Carlo sampling for the discretization of integrals, consistent with the numerical experiments.} Numerical experiments on one- and two-dimensional AC and CH systems confirm our theoretical results. Additionally, our analysis reveals that feedforward neural networks with two hidden layers and the tanh activation function bound the approximation errors of the solution, its temporal derivative, and the nonlinear term, constrained by the training loss and the number of collocation points.
format Preprint
id arxiv_https___arxiv_org_abs_2402_02667
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Priori Error Estimation of Physics-Informed Neural Networks Solving Allen--Cahn and Cahn--Hilliard Equations
Zhang, Guangtao
Lin, Jiani
Zhai, Qijia
Yang, Huiyu
Chen, Xujun
Leong, Ieng Tak
Zhu, Fang
Numerical Analysis
Optimization and Control
Physics-Informed Neural Networks (PINNs) encounter accuracy limitations when solving the Allen--Cahn (AC) and Cahn--Hilliard (CH) partial differential equations (PDEs). To overcome this, we employ a novel loss function, Residuals-weighted Region Activation Evaluation (Residuals-RAE), featuring a { pre-training weight update scheme}. { Unlike conventional self-adaptive PINNs where weights evolve simultaneously with network parameters, Residuals-RAE-PINNs computes weights from current residuals before each training step and holds them constant during gradient updates. We establish weight convergence under standard neural network optimization assumptions, which justifies analyzing the converged network with constant weights.} Based on this theoretical framework, we derive the error estimation for PINNs with Residuals-RAE when solving AC and CH equations. {The analysis is aligned with Monte-Carlo sampling for the discretization of integrals, consistent with the numerical experiments.} Numerical experiments on one- and two-dimensional AC and CH systems confirm our theoretical results. Additionally, our analysis reveals that feedforward neural networks with two hidden layers and the tanh activation function bound the approximation errors of the solution, its temporal derivative, and the nonlinear term, constrained by the training loss and the number of collocation points.
title A Priori Error Estimation of Physics-Informed Neural Networks Solving Allen--Cahn and Cahn--Hilliard Equations
topic Numerical Analysis
Optimization and Control
url https://arxiv.org/abs/2402.02667