Reinforcement Learning for Accelerated Aerodynamic Shape Optimisation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Sobieczky, Florian, Lopez, Alfredo, Dudkin, Erika, Lackner, Christopher, Hochsteger, Matthias, Scheichl, Bernhard, Sobieczky, Helmut
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912499018760192
author Sobieczky, Florian
Lopez, Alfredo
Dudkin, Erika
Lackner, Christopher
Hochsteger, Matthias
Scheichl, Bernhard
Sobieczky, Helmut
author_facet Sobieczky, Florian
Lopez, Alfredo
Dudkin, Erika
Lackner, Christopher
Hochsteger, Matthias
Scheichl, Bernhard
Sobieczky, Helmut
contents We introduce a reinforcement learning (RL) based adaptive optimization algorithm for aerodynamic shape optimization focused on dimensionality reduction. The form in which RL is applied here is that of a surrogate-based, actor-critic policy evaluation MCMC approach allowing for temporal 'freezing' of some of the parameters to be optimized. The goals are to minimize computational effort, and to use the observed optimization results for interpretation of the discovered extrema in terms of their role in achieving the desired flow-field. By a sequence of local optimized parameter changes around intermediate CFD simulations acting as ground truth, it is possible to speed up the global optimization if (a) the local neighbourhoods of the parameters in which the changed parameters must reside are sufficiently large to compete with the grid-sized steps and its large number of simulations, and (b) the estimates of the rewards and costs on these neighbourhoods necessary for a good step-wise parameter adaption are sufficiently accurate. We give an example of a simple fluid-dynamical problem on which the method allows interpretation in the sense of a feature importance scoring.
format Preprint
id arxiv_https___arxiv_org_abs_2507_17786
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Reinforcement Learning for Accelerated Aerodynamic Shape Optimisation
Sobieczky, Florian
Lopez, Alfredo
Dudkin, Erika
Lackner, Christopher
Hochsteger, Matthias
Scheichl, Bernhard
Sobieczky, Helmut
Machine Learning
We introduce a reinforcement learning (RL) based adaptive optimization algorithm for aerodynamic shape optimization focused on dimensionality reduction. The form in which RL is applied here is that of a surrogate-based, actor-critic policy evaluation MCMC approach allowing for temporal 'freezing' of some of the parameters to be optimized. The goals are to minimize computational effort, and to use the observed optimization results for interpretation of the discovered extrema in terms of their role in achieving the desired flow-field. By a sequence of local optimized parameter changes around intermediate CFD simulations acting as ground truth, it is possible to speed up the global optimization if (a) the local neighbourhoods of the parameters in which the changed parameters must reside are sufficiently large to compete with the grid-sized steps and its large number of simulations, and (b) the estimates of the rewards and costs on these neighbourhoods necessary for a good step-wise parameter adaption are sufficiently accurate. We give an example of a simple fluid-dynamical problem on which the method allows interpretation in the sense of a feature importance scoring.
title Reinforcement Learning for Accelerated Aerodynamic Shape Optimisation
topic Machine Learning
url https://arxiv.org/abs/2507.17786