Shallow neural network yields regularization for ill-posed inverse problems

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wang, Lan, Zhu, Qiao, Jin, Bangti, Zhang, Ye
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908666785955840
author Wang, Lan
Zhu, Qiao
Jin, Bangti
Zhang, Ye
author_facet Wang, Lan
Zhu, Qiao
Jin, Bangti
Zhang, Ye
contents In this paper, we establish universal approximation theorems for neural networks applied to general nonlinear ill-posed operator equations. In addition to the approximation error, the measurement error is also taken into account in our error estimation. We introduce the expanding neural network method as a novel iterative regularization scheme and prove its regularization properties under different a priori assumptions about the exact solutions. Within this framework, the number of neurons serves as both the regularization parameter and iteration number. We demonstrate that for data with high noise levels, a small network architecture is sufficient to obtain a stable solution, whereas a larger architecture may compromise stability due to overfitting. Furthermore, under standard assumptions in regularization theory, we derive convergence rate results for neural networks in the context of variational regularization. Several numerical examples are presented to illustrate the robustness of the proposed neural network-based algorithms.
format Preprint
id arxiv_https___arxiv_org_abs_2511_16171
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Shallow neural network yields regularization for ill-posed inverse problems
Wang, Lan
Zhu, Qiao
Jin, Bangti
Zhang, Ye
Numerical Analysis
In this paper, we establish universal approximation theorems for neural networks applied to general nonlinear ill-posed operator equations. In addition to the approximation error, the measurement error is also taken into account in our error estimation. We introduce the expanding neural network method as a novel iterative regularization scheme and prove its regularization properties under different a priori assumptions about the exact solutions. Within this framework, the number of neurons serves as both the regularization parameter and iteration number. We demonstrate that for data with high noise levels, a small network architecture is sufficient to obtain a stable solution, whereas a larger architecture may compromise stability due to overfitting. Furthermore, under standard assumptions in regularization theory, we derive convergence rate results for neural networks in the context of variational regularization. Several numerical examples are presented to illustrate the robustness of the proposed neural network-based algorithms.
title Shallow neural network yields regularization for ill-posed inverse problems
topic Numerical Analysis
url https://arxiv.org/abs/2511.16171