System-Aware Neural ODE Processes for Few-Shot Bayesian Optimization
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917826280816640 |
|---|---|
| author | Qing, Jixiang Langdon, Becky D Lee, Robert M Shafei, Behrang van der Wilk, Mark Tsay, Calvin Misener, Ruth |
| author_facet | Qing, Jixiang Langdon, Becky D Lee, Robert M Shafei, Behrang van der Wilk, Mark Tsay, Calvin Misener, Ruth |
| contents | We consider the problem of optimizing initial conditions and termination time in dynamical systems governed by unknown ordinary differential equations (ODEs), where evaluating different initial conditions is costly and the state's value can not be measured in real-time but only with a delay while the measuring device processes the sample. To identify the optimal conditions in limited trials, we introduce a few-shot Bayesian Optimization (BO) framework based on the system's prior information. At the core of our approach is the System-Aware Neural ODE Processes (SANODEP), an extension of Neural ODE Processes (NODEP) designed to meta-learn ODE systems from multiple trajectories using a novel context embedding block. We further develop a two-stage BO framework to effectively incorporate search space constraints, enabling efficient optimization of both initial conditions and observation timings. We conduct extensive experiments showcasing SANODEP's potential for few-shot BO within dynamical systems. We also explore SANODEP's adaptability to varying levels of prior information, highlighting the trade-off between prior flexibility and model fitting accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_02352 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | System-Aware Neural ODE Processes for Few-Shot Bayesian Optimization Qing, Jixiang Langdon, Becky D Lee, Robert M Shafei, Behrang van der Wilk, Mark Tsay, Calvin Misener, Ruth Machine Learning We consider the problem of optimizing initial conditions and termination time in dynamical systems governed by unknown ordinary differential equations (ODEs), where evaluating different initial conditions is costly and the state's value can not be measured in real-time but only with a delay while the measuring device processes the sample. To identify the optimal conditions in limited trials, we introduce a few-shot Bayesian Optimization (BO) framework based on the system's prior information. At the core of our approach is the System-Aware Neural ODE Processes (SANODEP), an extension of Neural ODE Processes (NODEP) designed to meta-learn ODE systems from multiple trajectories using a novel context embedding block. We further develop a two-stage BO framework to effectively incorporate search space constraints, enabling efficient optimization of both initial conditions and observation timings. We conduct extensive experiments showcasing SANODEP's potential for few-shot BO within dynamical systems. We also explore SANODEP's adaptability to varying levels of prior information, highlighting the trade-off between prior flexibility and model fitting accuracy. |
| title | System-Aware Neural ODE Processes for Few-Shot Bayesian Optimization |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2406.02352 |