Saved in:
Bibliographic Details
Main Authors: Gao, Zhiwei, Yan, Liang, Zhou, Tao
Format: Preprint
Published: 2023
Subjects:
Online Access:https://arxiv.org/abs/2310.17844
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912013853130752
author Gao, Zhiwei
Yan, Liang
Zhou, Tao
author_facet Gao, Zhiwei
Yan, Liang
Zhou, Tao
contents The fundamental computational issues in Bayesian inverse problems (BIP) governed by partial differential equations (PDEs) stem from the requirement of repeated forward model evaluations. A popular strategy to reduce such costs is to replace expensive model simulations with computationally efficient approximations using operator learning, motivated by recent progress in deep learning. However, using the approximated model directly may introduce a modeling error, exacerbating the already ill-posedness of inverse problems. Thus, balancing between accuracy and efficiency is essential for the effective implementation of such approaches. To this end, we develop an adaptive operator learning framework that can reduce modeling error gradually by forcing the surrogate to be accurate in local areas. This is accomplished by adaptively fine-tuning the pre-trained approximate model with training points chosen by a greedy algorithm during the posterior evaluation process. To validate our approach, we use DeepOnet to construct the surrogate and unscented Kalman inversion (UKI) to approximate the BIP solution, respectively. Furthermore, we present a rigorous convergence guarantee in the linear case using the UKI framework. The approach is tested on a number of benchmarks, including the Darcy flow, the heat source inversion problem, and the reaction-diffusion problem. The numerical results show that our method can significantly reduce computational costs while maintaining inversion accuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2310_17844
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Adaptive operator learning for infinite-dimensional Bayesian inverse problems
Gao, Zhiwei
Yan, Liang
Zhou, Tao
Numerical Analysis
Computation
Machine Learning
The fundamental computational issues in Bayesian inverse problems (BIP) governed by partial differential equations (PDEs) stem from the requirement of repeated forward model evaluations. A popular strategy to reduce such costs is to replace expensive model simulations with computationally efficient approximations using operator learning, motivated by recent progress in deep learning. However, using the approximated model directly may introduce a modeling error, exacerbating the already ill-posedness of inverse problems. Thus, balancing between accuracy and efficiency is essential for the effective implementation of such approaches. To this end, we develop an adaptive operator learning framework that can reduce modeling error gradually by forcing the surrogate to be accurate in local areas. This is accomplished by adaptively fine-tuning the pre-trained approximate model with training points chosen by a greedy algorithm during the posterior evaluation process. To validate our approach, we use DeepOnet to construct the surrogate and unscented Kalman inversion (UKI) to approximate the BIP solution, respectively. Furthermore, we present a rigorous convergence guarantee in the linear case using the UKI framework. The approach is tested on a number of benchmarks, including the Darcy flow, the heat source inversion problem, and the reaction-diffusion problem. The numerical results show that our method can significantly reduce computational costs while maintaining inversion accuracy.
title Adaptive operator learning for infinite-dimensional Bayesian inverse problems
topic Numerical Analysis
Computation
Machine Learning
url https://arxiv.org/abs/2310.17844