Challenges in automatic differentiation and numerical integration in physics-informed neural networks modelling
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909705583984640 |
|---|---|
| author | Daněk, Josef Pospíšil, Jan |
| author_facet | Daněk, Josef Pospíšil, Jan |
| contents | In this paper, we numerically examine the precision challenges that emerge in automatic differentiation and numerical integration in various tasks now tackled by physics-informed neural networks (PINNs). Specifically, we illustrate how ill-posed problems or inaccurately computed functions can cause serious precision issues in differentiation and integration. A major difficulty lies in detecting these problems. A simple large-scale view of the function or good-looking loss functions or convergence results may not reveal any potential errors, and the resulting outcomes are often mistakenly considered correct. To address this, it is critical to determine whether standard double-precision arithmetic suffices or if higher precision is necessary. Three problematic use-cases for solving differential equations using PINNs are analysed in detail. For the case requiring numerical integration, we also evaluate several numerical quadrature methods and suggest particular numerical analysis steps to choose the most suitable method. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_05172 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Challenges in automatic differentiation and numerical integration in physics-informed neural networks modelling Daněk, Josef Pospíšil, Jan Numerical Analysis 65D30, 65G30, 68T07 G.1.0; G.1.4; I.2.6; J.2 In this paper, we numerically examine the precision challenges that emerge in automatic differentiation and numerical integration in various tasks now tackled by physics-informed neural networks (PINNs). Specifically, we illustrate how ill-posed problems or inaccurately computed functions can cause serious precision issues in differentiation and integration. A major difficulty lies in detecting these problems. A simple large-scale view of the function or good-looking loss functions or convergence results may not reveal any potential errors, and the resulting outcomes are often mistakenly considered correct. To address this, it is critical to determine whether standard double-precision arithmetic suffices or if higher precision is necessary. Three problematic use-cases for solving differential equations using PINNs are analysed in detail. For the case requiring numerical integration, we also evaluate several numerical quadrature methods and suggest particular numerical analysis steps to choose the most suitable method. |
| title | Challenges in automatic differentiation and numerical integration in physics-informed neural networks modelling |
| topic | Numerical Analysis 65D30, 65G30, 68T07 G.1.0; G.1.4; I.2.6; J.2 |
| url | https://arxiv.org/abs/2408.05172 |