Scaling up machine learning-based chemical plant simulation: A method for fine-tuning a model to induce stable fixed points

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Esders, Malte, Ramirez, Gimmy Alex Fernandez, Gastegger, Michael, Samal, Satya Swarup
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916087858200576
author Esders, Malte
Ramirez, Gimmy Alex Fernandez
Gastegger, Michael
Samal, Satya Swarup
author_facet Esders, Malte
Ramirez, Gimmy Alex Fernandez
Gastegger, Michael
Samal, Satya Swarup
contents Idealized first-principles models of chemical plants can be inaccurate. An alternative is to fit a Machine Learning (ML) model directly to plant sensor data. We use a structured approach: Each unit within the plant gets represented by one ML model. After fitting the models to the data, the models are connected into a flowsheet-like directed graph. We find that for smaller plants, this approach works well, but for larger plants, the complex dynamics arising from large and nested cycles in the flowsheet lead to instabilities in the solver during model initialization. We show that a high accuracy of the single-unit models is not enough: The gradient can point in unexpected directions, which prevents the solver from converging to the correct stationary state. To address this problem, we present a way to fine-tune ML models such that initialization, even with very simple solvers, becomes robust.
format Preprint
id arxiv_https___arxiv_org_abs_2307_13621
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Scaling up machine learning-based chemical plant simulation: A method for fine-tuning a model to induce stable fixed points
Esders, Malte
Ramirez, Gimmy Alex Fernandez
Gastegger, Michael
Samal, Satya Swarup
Machine Learning
Computational Engineering, Finance, and Science
Systems and Control
Idealized first-principles models of chemical plants can be inaccurate. An alternative is to fit a Machine Learning (ML) model directly to plant sensor data. We use a structured approach: Each unit within the plant gets represented by one ML model. After fitting the models to the data, the models are connected into a flowsheet-like directed graph. We find that for smaller plants, this approach works well, but for larger plants, the complex dynamics arising from large and nested cycles in the flowsheet lead to instabilities in the solver during model initialization. We show that a high accuracy of the single-unit models is not enough: The gradient can point in unexpected directions, which prevents the solver from converging to the correct stationary state. To address this problem, we present a way to fine-tune ML models such that initialization, even with very simple solvers, becomes robust.
title Scaling up machine learning-based chemical plant simulation: A method for fine-tuning a model to induce stable fixed points
topic Machine Learning
Computational Engineering, Finance, and Science
Systems and Control
url https://arxiv.org/abs/2307.13621