Derivative-Informed Fourier Neural Operator: Universal Approximation and Applications to PDE-Constrained Optimization
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911516969664512 |
|---|---|
| author | Yao, Boyuan Luo, Dingcheng Cao, Lianghao Kovachki, Nikola O'Leary-Roseberry, Thomas Ghattas, Omar |
| author_facet | Yao, Boyuan Luo, Dingcheng Cao, Lianghao Kovachki, Nikola O'Leary-Roseberry, Thomas Ghattas, Omar |
| contents | We present approximation theories and efficient training methods for derivative-informed Fourier neural operators (DIFNOs) with applications to PDE-constrained optimization. A DIFNO is an FNO trained by minimizing its prediction error jointly on output and Fréchet derivative samples of a high-fidelity operator (e.g., a parametric PDE solution operator). As a result, a DIFNO can closely emulate not only the high-fidelity operator's response but also its sensitivities. To motivate the use of DIFNOs instead of conventional FNOs as surrogate models, we show that accurate surrogate-driven PDE-constrained optimization requires accurate surrogate Fréchet derivatives. Then, we establish (i) simultaneous universal approximation of continuously differentiable operators and their Fréchet derivatives by FNOs on compact sets, and (ii) universal approximation of continuously differentiable operators by FNOs in weighted Sobolev spaces with input measures that have unbounded supports. Our theoretical results certify the capability of FNOs for accurate derivative-informed operator learning and for the solution of PDE-constrained optimization problems. Furthermore, we develop efficient training schemes that leverage dimensionality reduction and multi-resolution techniques to significantly reduce memory and computational costs in Fréchet derivative learning. Numerical examples on nonlinear diffusion--reaction, Helmholtz, and Navier--Stokes equations demonstrate that DIFNOs are superior in sample complexity for operator learning and solving infinite-dimensional PDE-constrained inverse problems, achieving high accuracy at low training sample sizes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2512_14086 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Derivative-Informed Fourier Neural Operator: Universal Approximation and Applications to PDE-Constrained Optimization Yao, Boyuan Luo, Dingcheng Cao, Lianghao Kovachki, Nikola O'Leary-Roseberry, Thomas Ghattas, Omar Machine Learning Numerical Analysis 41A65, 68T07 (Primary) 65K10, 65J22 (Secondary) We present approximation theories and efficient training methods for derivative-informed Fourier neural operators (DIFNOs) with applications to PDE-constrained optimization. A DIFNO is an FNO trained by minimizing its prediction error jointly on output and Fréchet derivative samples of a high-fidelity operator (e.g., a parametric PDE solution operator). As a result, a DIFNO can closely emulate not only the high-fidelity operator's response but also its sensitivities. To motivate the use of DIFNOs instead of conventional FNOs as surrogate models, we show that accurate surrogate-driven PDE-constrained optimization requires accurate surrogate Fréchet derivatives. Then, we establish (i) simultaneous universal approximation of continuously differentiable operators and their Fréchet derivatives by FNOs on compact sets, and (ii) universal approximation of continuously differentiable operators by FNOs in weighted Sobolev spaces with input measures that have unbounded supports. Our theoretical results certify the capability of FNOs for accurate derivative-informed operator learning and for the solution of PDE-constrained optimization problems. Furthermore, we develop efficient training schemes that leverage dimensionality reduction and multi-resolution techniques to significantly reduce memory and computational costs in Fréchet derivative learning. Numerical examples on nonlinear diffusion--reaction, Helmholtz, and Navier--Stokes equations demonstrate that DIFNOs are superior in sample complexity for operator learning and solving infinite-dimensional PDE-constrained inverse problems, achieving high accuracy at low training sample sizes. |
| title | Derivative-Informed Fourier Neural Operator: Universal Approximation and Applications to PDE-Constrained Optimization |
| topic | Machine Learning Numerical Analysis 41A65, 68T07 (Primary) 65K10, 65J22 (Secondary) |
| url | https://arxiv.org/abs/2512.14086 |