ELM-FBPINNs: An Efficient Multilevel Random Feature Method

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Anderson, Samuel, Dolean, Victorita, Moseley, Ben, Pestana, Jennifer
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913142345302016
author Anderson, Samuel
Dolean, Victorita
Moseley, Ben
Pestana, Jennifer
author_facet Anderson, Samuel
Dolean, Victorita
Moseley, Ben
Pestana, Jennifer
contents Domain-decomposed variants of physics-informed neural networks (PINNs) such as finite basis PINNs (FBPINNs) mitigate some of PINNs' issues like slow convergence and spectral bias through localisation, but still rely on iterative nonlinear optimisation within each subdomain. In this work, we propose a hybrid approach that combines multilevel domain decomposition and partition-of-unity constructions with random feature models, yielding a method referred to as multilevel ELM-FBPINN. By replacing trainable subdomain networks with extreme learning machines, the resulting formulation eliminates backpropagation entirely and reduces training to a structured linear least-squares problem. We provide a systematic numerical study comparing ELM-FBPINNs and multilevel ELM-FBPINNs with standard PINNs and FBPINNs on representative benchmark problems, demonstrating that ELM-FBPINNs and multilevel ELM-FBPINNs achieve competitive accuracy while significantly accelerating convergence and improving robustness with respect to architectural and optimisation parameters. Through ablation studies, we further clarify the distinct roles of domain decomposition and random feature enrichment in controlling expressivity, conditioning, and scalability.
format Preprint
id arxiv_https___arxiv_org_abs_2409_01949
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ELM-FBPINNs: An Efficient Multilevel Random Feature Method
Anderson, Samuel
Dolean, Victorita
Moseley, Ben
Pestana, Jennifer
Numerical Analysis
Domain-decomposed variants of physics-informed neural networks (PINNs) such as finite basis PINNs (FBPINNs) mitigate some of PINNs' issues like slow convergence and spectral bias through localisation, but still rely on iterative nonlinear optimisation within each subdomain. In this work, we propose a hybrid approach that combines multilevel domain decomposition and partition-of-unity constructions with random feature models, yielding a method referred to as multilevel ELM-FBPINN. By replacing trainable subdomain networks with extreme learning machines, the resulting formulation eliminates backpropagation entirely and reduces training to a structured linear least-squares problem. We provide a systematic numerical study comparing ELM-FBPINNs and multilevel ELM-FBPINNs with standard PINNs and FBPINNs on representative benchmark problems, demonstrating that ELM-FBPINNs and multilevel ELM-FBPINNs achieve competitive accuracy while significantly accelerating convergence and improving robustness with respect to architectural and optimisation parameters. Through ablation studies, we further clarify the distinct roles of domain decomposition and random feature enrichment in controlling expressivity, conditioning, and scalability.
title ELM-FBPINNs: An Efficient Multilevel Random Feature Method
topic Numerical Analysis
url https://arxiv.org/abs/2409.01949