Harnessing the Power of Gradient-Based Simulations for Multi-Objective Optimization in Particle Accelerators
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866910687992741888 |
|---|---|
| author | Rajput, Kishansingh Schram, Malachi Edelen, Auralee Colen, Jonathan Kasparian, Armen Roussel, Ryan Carpenter, Adam Zhang, He Benesch, Jay |
| author_facet | Rajput, Kishansingh Schram, Malachi Edelen, Auralee Colen, Jonathan Kasparian, Armen Roussel, Ryan Carpenter, Adam Zhang, He Benesch, Jay |
| contents | Particle accelerator operation requires simultaneous optimization of multiple objectives. Multi-Objective Optimization (MOO) is particularly challenging due to trade-offs between the objectives. Evolutionary algorithms, such as genetic algorithm (GA), have been leveraged for many optimization problems, however, they do not apply to complex control problems by design. This paper demonstrates the power of differentiability for solving MOO problems using a Deep Differentiable Reinforcement Learning (DDRL) algorithm in particle accelerators. We compare DDRL algorithm with Model Free Reinforcement Learning (MFRL), GA and Bayesian Optimization (BO) for simultaneous optimization of heat load and trip rates in the Continuous Electron Beam Accelerator Facility (CEBAF). The underlying problem enforces strict constraints on both individual states and actions as well as cumulative (global) constraint for energy requirements of the beam. A physics-based surrogate model based on real data is developed. This surrogate model is differentiable and allows back-propagation of gradients. The results are evaluated in the form of a Pareto-front for two objectives. We show that the DDRL outperforms MFRL, BO, and GA on high dimensional problems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_04817 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Harnessing the Power of Gradient-Based Simulations for Multi-Objective Optimization in Particle Accelerators Rajput, Kishansingh Schram, Malachi Edelen, Auralee Colen, Jonathan Kasparian, Armen Roussel, Ryan Carpenter, Adam Zhang, He Benesch, Jay Accelerator Physics Neural and Evolutionary Computing Particle accelerator operation requires simultaneous optimization of multiple objectives. Multi-Objective Optimization (MOO) is particularly challenging due to trade-offs between the objectives. Evolutionary algorithms, such as genetic algorithm (GA), have been leveraged for many optimization problems, however, they do not apply to complex control problems by design. This paper demonstrates the power of differentiability for solving MOO problems using a Deep Differentiable Reinforcement Learning (DDRL) algorithm in particle accelerators. We compare DDRL algorithm with Model Free Reinforcement Learning (MFRL), GA and Bayesian Optimization (BO) for simultaneous optimization of heat load and trip rates in the Continuous Electron Beam Accelerator Facility (CEBAF). The underlying problem enforces strict constraints on both individual states and actions as well as cumulative (global) constraint for energy requirements of the beam. A physics-based surrogate model based on real data is developed. This surrogate model is differentiable and allows back-propagation of gradients. The results are evaluated in the form of a Pareto-front for two objectives. We show that the DDRL outperforms MFRL, BO, and GA on high dimensional problems. |
| title | Harnessing the Power of Gradient-Based Simulations for Multi-Objective Optimization in Particle Accelerators |
| topic | Accelerator Physics Neural and Evolutionary Computing |
| url | https://arxiv.org/abs/2411.04817 |