Optimal Stopping for Sequential Bayesian Experimental Design

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cheng, Chen, Huan, Xun
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917541471846400
author Cheng, Chen
Huan, Xun
author_facet Cheng, Chen
Huan, Xun
contents Sequential Bayesian experimental design typically assumes that the number of experiments is fixed before data collection begins. In practical campaigns, however, experimentation may need to terminate early because additional measurements can provide diminishing information relative to their cost, raising the central decision question: when should one stop? Common threshold-based stopping rules are easy to implement but myopic, because they compare the current state with a fixed criterion without accounting for the expected value of future experiments. This work develops a Bayesian optimal stopping framework for sequential experimental design by formulating stopping and design as coupled decisions in a Markov decision process. We prove that, for any design policy, the optimal stopping rule terminates exactly when the immediate terminal reward exceeds the expected continuation value. We then derive a policy gradient method for learning value-based stopping and design policies. Naïve joint training can create a circular dependency that traps learning in early-stopping local optima. We address this difficulty with a curriculum learning strategy that gradually transitions from forced continuation to adaptive stopping during training. Numerical studies on a linear-Gaussian benchmark, a one-dimensional nonlinear test problem, and a contaminant source detection problem show that the proposed approach learns stable design-stopping policies and improves resource-aware performance, with the largest gains in settings with strong sequential dependence.
format Preprint
id arxiv_https___arxiv_org_abs_2509_21734
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Optimal Stopping for Sequential Bayesian Experimental Design
Cheng, Chen
Huan, Xun
Methodology
Sequential Bayesian experimental design typically assumes that the number of experiments is fixed before data collection begins. In practical campaigns, however, experimentation may need to terminate early because additional measurements can provide diminishing information relative to their cost, raising the central decision question: when should one stop? Common threshold-based stopping rules are easy to implement but myopic, because they compare the current state with a fixed criterion without accounting for the expected value of future experiments. This work develops a Bayesian optimal stopping framework for sequential experimental design by formulating stopping and design as coupled decisions in a Markov decision process. We prove that, for any design policy, the optimal stopping rule terminates exactly when the immediate terminal reward exceeds the expected continuation value. We then derive a policy gradient method for learning value-based stopping and design policies. Naïve joint training can create a circular dependency that traps learning in early-stopping local optima. We address this difficulty with a curriculum learning strategy that gradually transitions from forced continuation to adaptive stopping during training. Numerical studies on a linear-Gaussian benchmark, a one-dimensional nonlinear test problem, and a contaminant source detection problem show that the proposed approach learns stable design-stopping policies and improves resource-aware performance, with the largest gains in settings with strong sequential dependence.
title Optimal Stopping for Sequential Bayesian Experimental Design
topic Methodology
url https://arxiv.org/abs/2509.21734