Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2504.13320 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912593631772672 |
|---|---|
| author | Gruhlke, Robert Hanu, Matei Schillings, Claudia Wacker, Philipp |
| author_facet | Gruhlke, Robert Hanu, Matei Schillings, Claudia Wacker, Philipp |
| contents | We introduce a gradient-free framework for Bayesian Optimal Experimental Design (BOED) in sequential settings, aimed at complex systems where gradient information is unavailable. Our method combines Ensemble Kalman Inversion (EKI) for design optimization with the Affine-Invariant Langevin Dynamics (ALDI) sampler for efficient posterior sampling-both of which are derivative-free and ensemble-based. To address the computational challenges posed by nested expectations in BOED, we propose variational Gaussian and parametrized Laplace approximations that provide tractable upper and lower bounds on the Expected Information Gain (EIG). These approximations enable scalable utility estimation in high-dimensional spaces and PDE-constrained inverse problems. We demonstrate the performance of our framework through numerical experiments ranging from linear Gaussian models to PDE-based inference tasks, highlighting the method's robustness, accuracy, and efficiency in information-driven experimental design. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_13320 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Gradient-Free Sequential Bayesian Experimental Design via Interacting Particle Systems Gruhlke, Robert Hanu, Matei Schillings, Claudia Wacker, Philipp Machine Learning Numerical Analysis Computation 62K05, 62F15, 65C05, 93E10 We introduce a gradient-free framework for Bayesian Optimal Experimental Design (BOED) in sequential settings, aimed at complex systems where gradient information is unavailable. Our method combines Ensemble Kalman Inversion (EKI) for design optimization with the Affine-Invariant Langevin Dynamics (ALDI) sampler for efficient posterior sampling-both of which are derivative-free and ensemble-based. To address the computational challenges posed by nested expectations in BOED, we propose variational Gaussian and parametrized Laplace approximations that provide tractable upper and lower bounds on the Expected Information Gain (EIG). These approximations enable scalable utility estimation in high-dimensional spaces and PDE-constrained inverse problems. We demonstrate the performance of our framework through numerical experiments ranging from linear Gaussian models to PDE-based inference tasks, highlighting the method's robustness, accuracy, and efficiency in information-driven experimental design. |
| title | Gradient-Free Sequential Bayesian Experimental Design via Interacting Particle Systems |
| topic | Machine Learning Numerical Analysis Computation 62K05, 62F15, 65C05, 93E10 |
| url | https://arxiv.org/abs/2504.13320 |