Improved physics-informed neural network in mitigating gradient related failures
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866916338606276608 |
|---|---|
| author | Niu, Pancheng Chen, Yongming Guo, Jun Zhou, Yuqian Feng, Minfu Shi, Yanchao |
| author_facet | Niu, Pancheng Chen, Yongming Guo, Jun Zhou, Yuqian Feng, Minfu Shi, Yanchao |
| contents | Physics-informed neural networks (PINNs) integrate fundamental physical principles with advanced data-driven techniques, driving significant advancements in scientific computing. However, PINNs face persistent challenges with stiffness in gradient flow, which limits their predictive capabilities. This paper presents an improved PINN (I-PINN) to mitigate gradient-related failures. The core of I-PINN is to combine the respective strengths of neural networks with an improved architecture and adaptive weights containingupper bounds. The capability to enhance accuracy by at least one order of magnitude and accelerate convergence, without introducing extra computational complexity relative to the baseline model, is achieved by I-PINN. Numerical experiments with a variety of benchmarks illustrate the improved accuracy and generalization of I-PINN. The supporting data and code are accessible at https://github.com/PanChengN/I-PINN.git, enabling broader research engagement. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_19421 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Improved physics-informed neural network in mitigating gradient related failures Niu, Pancheng Chen, Yongming Guo, Jun Zhou, Yuqian Feng, Minfu Shi, Yanchao Machine Learning 35Q68, 35Q90 G.4 Physics-informed neural networks (PINNs) integrate fundamental physical principles with advanced data-driven techniques, driving significant advancements in scientific computing. However, PINNs face persistent challenges with stiffness in gradient flow, which limits their predictive capabilities. This paper presents an improved PINN (I-PINN) to mitigate gradient-related failures. The core of I-PINN is to combine the respective strengths of neural networks with an improved architecture and adaptive weights containingupper bounds. The capability to enhance accuracy by at least one order of magnitude and accelerate convergence, without introducing extra computational complexity relative to the baseline model, is achieved by I-PINN. Numerical experiments with a variety of benchmarks illustrate the improved accuracy and generalization of I-PINN. The supporting data and code are accessible at https://github.com/PanChengN/I-PINN.git, enabling broader research engagement. |
| title | Improved physics-informed neural network in mitigating gradient related failures |
| topic | Machine Learning 35Q68, 35Q90 G.4 |
| url | https://arxiv.org/abs/2407.19421 |