Enforcing the Principle of Locality for Physical Simulations with Neural Operators

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chen, Jiangce, Xu, Wenzhuo, Xu, Zeda, Gutiérrez, Noelia Grande, Narra, Sneha Prabha, McComb, Christopher
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916561860689920
author Chen, Jiangce
Xu, Wenzhuo
Xu, Zeda
Gutiérrez, Noelia Grande
Narra, Sneha Prabha
McComb, Christopher
author_facet Chen, Jiangce
Xu, Wenzhuo
Xu, Zeda
Gutiérrez, Noelia Grande
Narra, Sneha Prabha
McComb, Christopher
contents Time-dependent partial differential equations (PDEs) for classic physical systems are established based on the conservation of mass, momentum, and energy, which are ubiquitous in scientific and engineering applications. These PDEs are strictly local-dependent according to the principle of locality in physics, which means that the evolution at a point is only influenced by the neighborhood around it whose size is determined by the length of timestep multiplied with the speed of characteristic information traveling in the system. However, deep learning architecture cannot strictly enforce the local-dependency as it inevitably increases the scope of information to make local predictions as the number of layers increases. Under limited training data, the extra irrelevant information results in sluggish convergence and compromised generalizability. This paper aims to solve this problem by proposing a data decomposition method to strictly limit the scope of information for neural operators making local predictions, which is called data decomposition enforcing local-dependency (DDELD). The numerical experiments over multiple physical phenomena show that DDELD significantly accelerates training convergence and reduces test errors of benchmark models on large-scale engineering simulations.
format Preprint
id arxiv_https___arxiv_org_abs_2405_01319
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Enforcing the Principle of Locality for Physical Simulations with Neural Operators
Chen, Jiangce
Xu, Wenzhuo
Xu, Zeda
Gutiérrez, Noelia Grande
Narra, Sneha Prabha
McComb, Christopher
Machine Learning
Computational Engineering, Finance, and Science
Time-dependent partial differential equations (PDEs) for classic physical systems are established based on the conservation of mass, momentum, and energy, which are ubiquitous in scientific and engineering applications. These PDEs are strictly local-dependent according to the principle of locality in physics, which means that the evolution at a point is only influenced by the neighborhood around it whose size is determined by the length of timestep multiplied with the speed of characteristic information traveling in the system. However, deep learning architecture cannot strictly enforce the local-dependency as it inevitably increases the scope of information to make local predictions as the number of layers increases. Under limited training data, the extra irrelevant information results in sluggish convergence and compromised generalizability. This paper aims to solve this problem by proposing a data decomposition method to strictly limit the scope of information for neural operators making local predictions, which is called data decomposition enforcing local-dependency (DDELD). The numerical experiments over multiple physical phenomena show that DDELD significantly accelerates training convergence and reduces test errors of benchmark models on large-scale engineering simulations.
title Enforcing the Principle of Locality for Physical Simulations with Neural Operators
topic Machine Learning
Computational Engineering, Finance, and Science
url https://arxiv.org/abs/2405.01319