Survey and Tutorial of Reinforcement Learning Methods in Process Systems Engineering
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917047950114816 |
|---|---|
| author | Bloor, Maximilian Mowbray, Max Chanona, Ehecatl Antonio Del Rio Tsay, Calvin |
| author_facet | Bloor, Maximilian Mowbray, Max Chanona, Ehecatl Antonio Del Rio Tsay, Calvin |
| contents | Sequential decision making under uncertainty is central to many Process Systems Engineering (PSE) challenges, where traditional methods often face limitations related to controlling and optimizing complex and stochastic systems. Reinforcement Learning (RL) offers a data-driven approach to derive control policies for such challenges. This paper presents a survey and tutorial on RL methods, tailored for the PSE community. We deliver a tutorial on RL, covering fundamental concepts and key algorithmic families including value-based, policy-based and actor-critic methods. Subsequently, we survey existing applications of these RL techniques across various PSE domains, such as in fed-batch and continuous process control, process optimization, and supply chains. We conclude with PSE focused discussion of specialized techniques and emerging directions. By synthesizing the current state of RL algorithm development and implications for PSE this work identifies successes, challenges, trends, and outlines avenues for future research at the interface of these fields. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_24272 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Survey and Tutorial of Reinforcement Learning Methods in Process Systems Engineering Bloor, Maximilian Mowbray, Max Chanona, Ehecatl Antonio Del Rio Tsay, Calvin Systems and Control Artificial Intelligence Sequential decision making under uncertainty is central to many Process Systems Engineering (PSE) challenges, where traditional methods often face limitations related to controlling and optimizing complex and stochastic systems. Reinforcement Learning (RL) offers a data-driven approach to derive control policies for such challenges. This paper presents a survey and tutorial on RL methods, tailored for the PSE community. We deliver a tutorial on RL, covering fundamental concepts and key algorithmic families including value-based, policy-based and actor-critic methods. Subsequently, we survey existing applications of these RL techniques across various PSE domains, such as in fed-batch and continuous process control, process optimization, and supply chains. We conclude with PSE focused discussion of specialized techniques and emerging directions. By synthesizing the current state of RL algorithm development and implications for PSE this work identifies successes, challenges, trends, and outlines avenues for future research at the interface of these fields. |
| title | Survey and Tutorial of Reinforcement Learning Methods in Process Systems Engineering |
| topic | Systems and Control Artificial Intelligence |
| url | https://arxiv.org/abs/2510.24272 |