Design Guidelines for Noise-Tolerant Optimization with Applications in Robust Design
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929524588937216 |
|---|---|
| author | Lou, Yuchen Sun, Shigeng Nocedal, Jorge |
| author_facet | Lou, Yuchen Sun, Shigeng Nocedal, Jorge |
| contents | The development of nonlinear optimization algorithms capable of performing reliably in the presence of noise has garnered considerable attention lately. This paper advocates for strategies to create noise-tolerant nonlinear optimization algorithms by adapting classical deterministic methods. These adaptations follow certain design guidelines described here, which make use of estimates of the noise level in the problem. The application of our methodology is illustrated by the development of a line search gradient projection method, which is tested on an engineering design problem. It is shown that a new self-calibrated line search and noise-aware finite-difference techniques are effective even in the high noise regime. Numerical experiments investigate the resiliency of key algorithmic components. A convergence analysis of the line search gradient projection method establishes convergence to a neighborhood of stationarity. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_15007 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Design Guidelines for Noise-Tolerant Optimization with Applications in Robust Design Lou, Yuchen Sun, Shigeng Nocedal, Jorge Optimization and Control Numerical Analysis 90C30, 90C15, 93B51, 65K05 The development of nonlinear optimization algorithms capable of performing reliably in the presence of noise has garnered considerable attention lately. This paper advocates for strategies to create noise-tolerant nonlinear optimization algorithms by adapting classical deterministic methods. These adaptations follow certain design guidelines described here, which make use of estimates of the noise level in the problem. The application of our methodology is illustrated by the development of a line search gradient projection method, which is tested on an engineering design problem. It is shown that a new self-calibrated line search and noise-aware finite-difference techniques are effective even in the high noise regime. Numerical experiments investigate the resiliency of key algorithmic components. A convergence analysis of the line search gradient projection method establishes convergence to a neighborhood of stationarity. |
| title | Design Guidelines for Noise-Tolerant Optimization with Applications in Robust Design |
| topic | Optimization and Control Numerical Analysis 90C30, 90C15, 93B51, 65K05 |
| url | https://arxiv.org/abs/2401.15007 |