Benchmarking Machine Learning Uncertainty Quantification Methodologies for Predicting Turbine Gas Temperature Degradation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Barry-Straume, Jostein, Son, Changmin, Sandu, Adrian, Burke, Gavan, Sundararajan, Rekha, Rimell, Andrew, Steinrock, James G.
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911729621925888
author Barry-Straume, Jostein
Son, Changmin
Sandu, Adrian
Burke, Gavan
Sundararajan, Rekha
Rimell, Andrew
Steinrock, James G.
author_facet Barry-Straume, Jostein
Son, Changmin
Sandu, Adrian
Burke, Gavan
Sundararajan, Rekha
Rimell, Andrew
Steinrock, James G.
contents Effective prognostics and health management of modern engines relies on accurate turbine gas temperature predictions and robust uncertainty quantification to ensure reliability and safety. This paper investigates five major approaches for constructing prediction intervals -- namely the Delta method, Bayesian Monte Carlo Dropout, Bootstrap method, Lower-Upper Bound Estimation, and Mean-Variance Estimation -- as a means of capturing the uncertainty in neural network predictions of turbine gas temperature. Each approach is implemented within a unified experimental framework that employs cross-validation for hyperparameter selection, repeated train-test splits for performance robustness, and multiple metrics to evaluate both the accuracy and tightness of the intervals. In particular, Coverage Probability, Normalized Mean Prediction Interval Width, and the Coverage Width-based Criterion are measured to comprehensively assess each method's reliability and sharpness. Experiments conducted on a representative turbine gas temperature dataset reveal distinct trade-offs among the five methods in terms of interval coverage, width, and stability. These findings provide a practical guide for selecting and tuning prediction interval methods in engine health management and prognostics, ensuring both interpretability and precision in real-world applications.
format Preprint
id arxiv_https___arxiv_org_abs_2605_30585
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Benchmarking Machine Learning Uncertainty Quantification Methodologies for Predicting Turbine Gas Temperature Degradation
Barry-Straume, Jostein
Son, Changmin
Sandu, Adrian
Burke, Gavan
Sundararajan, Rekha
Rimell, Andrew
Steinrock, James G.
Machine Learning
Artificial Intelligence
Computational Engineering, Finance, and Science
I.2.1; I.2.6
Effective prognostics and health management of modern engines relies on accurate turbine gas temperature predictions and robust uncertainty quantification to ensure reliability and safety. This paper investigates five major approaches for constructing prediction intervals -- namely the Delta method, Bayesian Monte Carlo Dropout, Bootstrap method, Lower-Upper Bound Estimation, and Mean-Variance Estimation -- as a means of capturing the uncertainty in neural network predictions of turbine gas temperature. Each approach is implemented within a unified experimental framework that employs cross-validation for hyperparameter selection, repeated train-test splits for performance robustness, and multiple metrics to evaluate both the accuracy and tightness of the intervals. In particular, Coverage Probability, Normalized Mean Prediction Interval Width, and the Coverage Width-based Criterion are measured to comprehensively assess each method's reliability and sharpness. Experiments conducted on a representative turbine gas temperature dataset reveal distinct trade-offs among the five methods in terms of interval coverage, width, and stability. These findings provide a practical guide for selecting and tuning prediction interval methods in engine health management and prognostics, ensuring both interpretability and precision in real-world applications.
title Benchmarking Machine Learning Uncertainty Quantification Methodologies for Predicting Turbine Gas Temperature Degradation
topic Machine Learning
Artificial Intelligence
Computational Engineering, Finance, and Science
I.2.1; I.2.6
url https://arxiv.org/abs/2605.30585