A domain decomposition-based autoregressive deep learning model for unsteady and nonlinear partial differential equations

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nidhan, Sheel, Jiang, Haoliang, Ghule, Lalit, Umphrey, Clancy, Ranade, Rishikesh, Pathak, Jay
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917930204135424
author Nidhan, Sheel
Jiang, Haoliang
Ghule, Lalit
Umphrey, Clancy
Ranade, Rishikesh
Pathak, Jay
author_facet Nidhan, Sheel
Jiang, Haoliang
Ghule, Lalit
Umphrey, Clancy
Ranade, Rishikesh
Pathak, Jay
contents In this paper, we propose a domain-decomposition-based deep learning (DL) framework, named transient-CoMLSim, for accurately modeling unsteady and nonlinear partial differential equations (PDEs). The framework consists of two key components: (a) a convolutional neural network (CNN)-based autoencoder architecture and (b) an autoregressive model composed of fully connected layers. Unlike existing state-of-the-art methods that operate on the entire computational domain, our CNN-based autoencoder computes a lower-dimensional basis for solution and condition fields represented on subdomains. Timestepping is performed entirely in the latent space, generating embeddings of the solution variables from the time history of embeddings of solution and condition variables. This approach not only reduces computational complexity but also enhances scalability, making it well-suited for large-scale simulations. Furthermore, to improve the stability of our rollouts, we employ a curriculum learning (CL) approach during the training of the autoregressive model. The domain-decomposition strategy enables scaling to out-of-distribution domain sizes while maintaining the accuracy of predictions -- a feature not easily integrated into popular DL-based approaches for physics simulations. We benchmark our model against two widely-used DL architectures, Fourier Neural Operator (FNO) and U-Net, and demonstrate that our framework outperforms them in terms of accuracy, extrapolation to unseen timesteps, and stability for a wide range of use cases.
format Preprint
id arxiv_https___arxiv_org_abs_2408_14461
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A domain decomposition-based autoregressive deep learning model for unsteady and nonlinear partial differential equations
Nidhan, Sheel
Jiang, Haoliang
Ghule, Lalit
Umphrey, Clancy
Ranade, Rishikesh
Pathak, Jay
Machine Learning
Fluid Dynamics
In this paper, we propose a domain-decomposition-based deep learning (DL) framework, named transient-CoMLSim, for accurately modeling unsteady and nonlinear partial differential equations (PDEs). The framework consists of two key components: (a) a convolutional neural network (CNN)-based autoencoder architecture and (b) an autoregressive model composed of fully connected layers. Unlike existing state-of-the-art methods that operate on the entire computational domain, our CNN-based autoencoder computes a lower-dimensional basis for solution and condition fields represented on subdomains. Timestepping is performed entirely in the latent space, generating embeddings of the solution variables from the time history of embeddings of solution and condition variables. This approach not only reduces computational complexity but also enhances scalability, making it well-suited for large-scale simulations. Furthermore, to improve the stability of our rollouts, we employ a curriculum learning (CL) approach during the training of the autoregressive model. The domain-decomposition strategy enables scaling to out-of-distribution domain sizes while maintaining the accuracy of predictions -- a feature not easily integrated into popular DL-based approaches for physics simulations. We benchmark our model against two widely-used DL architectures, Fourier Neural Operator (FNO) and U-Net, and demonstrate that our framework outperforms them in terms of accuracy, extrapolation to unseen timesteps, and stability for a wide range of use cases.
title A domain decomposition-based autoregressive deep learning model for unsteady and nonlinear partial differential equations
topic Machine Learning
Fluid Dynamics
url https://arxiv.org/abs/2408.14461