Where's Ben Nevis? A 2D optimisation benchmark with 957,174 local optima based on Great Britain terrain data
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910630961741824 |
|---|---|
| author | Wei, Yuhang Clerx, Michael Mirams, Gary R. |
| author_facet | Wei, Yuhang Clerx, Michael Mirams, Gary R. |
| contents | We present a novel optimisation benchmark based on the real landscape of Great Britain (GB). The elevation data from the UK Ordnance Survey Terrain 50 dataset is slightly modified and linearly interpolated to produce a target function that simulates the GB terrain, packaged in a new Python module nevis. We introduce a discrete approach to classifying local optima and their corresponding basins of attraction, identifying 957,174 local optima of the target function. We then develop a benchmarking framework for optimisation methods based on this target function, where we propose a Generalised Expected Running Time performance measure to enable meaningful comparisons even when algorithms do not achieve successful runs (find Ben Nevis). Hyperparameter tuning is managed using the optuna framework, and plots and animations are produced to visualise algorithm performance. Using the proposed framework, we benchmark six optimisation algorithms implemented by common Python modules. Amongst those tested, the Differential Evolution algorithm implemented by scipy is the most effective for navigating the complex GB landscape and finding the summit of Ben Nevis. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_02422 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Where's Ben Nevis? A 2D optimisation benchmark with 957,174 local optima based on Great Britain terrain data Wei, Yuhang Clerx, Michael Mirams, Gary R. Optimization and Control 90C26, 65K05 G.1.6 We present a novel optimisation benchmark based on the real landscape of Great Britain (GB). The elevation data from the UK Ordnance Survey Terrain 50 dataset is slightly modified and linearly interpolated to produce a target function that simulates the GB terrain, packaged in a new Python module nevis. We introduce a discrete approach to classifying local optima and their corresponding basins of attraction, identifying 957,174 local optima of the target function. We then develop a benchmarking framework for optimisation methods based on this target function, where we propose a Generalised Expected Running Time performance measure to enable meaningful comparisons even when algorithms do not achieve successful runs (find Ben Nevis). Hyperparameter tuning is managed using the optuna framework, and plots and animations are produced to visualise algorithm performance. Using the proposed framework, we benchmark six optimisation algorithms implemented by common Python modules. Amongst those tested, the Differential Evolution algorithm implemented by scipy is the most effective for navigating the complex GB landscape and finding the summit of Ben Nevis. |
| title | Where's Ben Nevis? A 2D optimisation benchmark with 957,174 local optima based on Great Britain terrain data |
| topic | Optimization and Control 90C26, 65K05 G.1.6 |
| url | https://arxiv.org/abs/2410.02422 |