Saved in:
Bibliographic Details
Main Authors: Nießen, Jonas, Müller, Johannes
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.07311
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916732644360192
author Nießen, Jonas
Müller, Johannes
author_facet Nießen, Jonas
Müller, Johannes
contents In this work, we provide a non-asymptotic convergence analysis of projected gradient descent for physics-informed neural networks for the Poisson equation. Under suitable assumptions, we show that the optimization error can be bounded by $\mathcal{O}(1/\sqrt{T} + 1/\sqrt{m} + ε_{\text{approx}})$, where $T$ is the number of algorithm time steps, $m$ is the width of the neural network and $ε_{\text{approx}}$ is an approximation error. The proof of our optimization result relies on bounding the linearization error and using this result together with a Lyapunov drift analysis. Additionally, we quantify the generalization error by bounding the Rademacher complexities of the neural network and its Laplacian. Combining both the optimization and generalization results, we obtain an overall error estimate based on an existing error estimate from regularity theory.
format Preprint
id arxiv_https___arxiv_org_abs_2505_07311
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Non-Asymptotic Analysis of Projected Gradient Descent for Physics-Informed Neural Networks
Nießen, Jonas
Müller, Johannes
Optimization and Control
68T07, 65N15
In this work, we provide a non-asymptotic convergence analysis of projected gradient descent for physics-informed neural networks for the Poisson equation. Under suitable assumptions, we show that the optimization error can be bounded by $\mathcal{O}(1/\sqrt{T} + 1/\sqrt{m} + ε_{\text{approx}})$, where $T$ is the number of algorithm time steps, $m$ is the width of the neural network and $ε_{\text{approx}}$ is an approximation error. The proof of our optimization result relies on bounding the linearization error and using this result together with a Lyapunov drift analysis. Additionally, we quantify the generalization error by bounding the Rademacher complexities of the neural network and its Laplacian. Combining both the optimization and generalization results, we obtain an overall error estimate based on an existing error estimate from regularity theory.
title Non-Asymptotic Analysis of Projected Gradient Descent for Physics-Informed Neural Networks
topic Optimization and Control
68T07, 65N15
url https://arxiv.org/abs/2505.07311