Guaranteed prediction sets for functional surrogate models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gray, Ander, Gopakumar, Vignesh, Rousseau, Sylvain, Destercke, Sébastien
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912440842715136
author Gray, Ander
Gopakumar, Vignesh
Rousseau, Sylvain
Destercke, Sébastien
author_facet Gray, Ander
Gopakumar, Vignesh
Rousseau, Sylvain
Destercke, Sébastien
contents We propose a method for obtaining statistically guaranteed prediction sets for functional machine learning methods: surrogate models which map between function spaces, motivated by the need to build reliable PDE emulators. The method constructs nested prediction sets on a low-dimensional representation (an SVD) of the surrogate model's error, and then maps these sets to the prediction space using set-propagation techniques. This results in prediction sets for functional surrogate models with conformal prediction coverage guarantees. We use zonotopes as basis of the set construction, which allow an exact linear propagation and are closed under Cartesian products, making them well-suited to this high-dimensional problem. The method is model agnostic and can thus be applied to complex Sci-ML models, including Neural Operators, but also in simpler settings. We also introduce a technique to capture the truncation error of the SVD, preserving the guarantees of the method.
format Preprint
id arxiv_https___arxiv_org_abs_2501_18426
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Guaranteed prediction sets for functional surrogate models
Gray, Ander
Gopakumar, Vignesh
Rousseau, Sylvain
Destercke, Sébastien
Machine Learning
Artificial Intelligence
We propose a method for obtaining statistically guaranteed prediction sets for functional machine learning methods: surrogate models which map between function spaces, motivated by the need to build reliable PDE emulators. The method constructs nested prediction sets on a low-dimensional representation (an SVD) of the surrogate model's error, and then maps these sets to the prediction space using set-propagation techniques. This results in prediction sets for functional surrogate models with conformal prediction coverage guarantees. We use zonotopes as basis of the set construction, which allow an exact linear propagation and are closed under Cartesian products, making them well-suited to this high-dimensional problem. The method is model agnostic and can thus be applied to complex Sci-ML models, including Neural Operators, but also in simpler settings. We also introduce a technique to capture the truncation error of the SVD, preserving the guarantees of the method.
title Guaranteed prediction sets for functional surrogate models
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2501.18426