Function Extrapolation with Neural Networks and Its Application for Manifolds

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hay, Guy, Sharon, Nir
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913353774923776
author Hay, Guy
Sharon, Nir
author_facet Hay, Guy
Sharon, Nir
contents This paper addresses the problem of accurately estimating a function on one domain when only its discrete samples are available on another domain. To answer this challenge, we utilize a neural network, which we train to incorporate prior knowledge of the function. In addition, by carefully analyzing the problem, we obtain a bound on the error over the extrapolation domain and define a condition number for this problem that quantifies the level of difficulty of the setup. Compared to other machine learning methods that provide time series prediction, such as transformers, our approach is suitable for setups where the interpolation and extrapolation regions are general subdomains and, in particular, manifolds. In addition, our construction leads to an improved loss function that helps us boost the accuracy and robustness of our neural network. We conduct comprehensive numerical tests and comparisons of our extrapolation versus standard methods. The results illustrate the effectiveness of our approach in various scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2405_10563
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Function Extrapolation with Neural Networks and Its Application for Manifolds
Hay, Guy
Sharon, Nir
Machine Learning
Numerical Analysis
65K05
This paper addresses the problem of accurately estimating a function on one domain when only its discrete samples are available on another domain. To answer this challenge, we utilize a neural network, which we train to incorporate prior knowledge of the function. In addition, by carefully analyzing the problem, we obtain a bound on the error over the extrapolation domain and define a condition number for this problem that quantifies the level of difficulty of the setup. Compared to other machine learning methods that provide time series prediction, such as transformers, our approach is suitable for setups where the interpolation and extrapolation regions are general subdomains and, in particular, manifolds. In addition, our construction leads to an improved loss function that helps us boost the accuracy and robustness of our neural network. We conduct comprehensive numerical tests and comparisons of our extrapolation versus standard methods. The results illustrate the effectiveness of our approach in various scenarios.
title Function Extrapolation with Neural Networks and Its Application for Manifolds
topic Machine Learning
Numerical Analysis
65K05
url https://arxiv.org/abs/2405.10563