Saved in:
Bibliographic Details
Main Authors: Zeng, Zhihan, Gu, Yiqi
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2507.16380
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • This work focuses on the behavior of stochastic gradient descent (SGD) in solving least-squares regression with physics-informed neural networks (PINNs). Past work on this topic has been based on the over-parameterization regime, whose convergence may require the network width to increase vastly with the number of training samples. So, the theory derived from over-parameterization may incur prohibitive computational costs and is far from practical experiments. We perform new optimization and generalization analysis for SGD in training two-layer PINNs, making certain assumptions about the target function to avoid over-parameterization. Given $ε>0$, we show that if the network width exceeds a threshold that depends only on $ε$ and the problem, then the training loss and expected loss will decrease below $O(ε)$.