Probabilistic Forecasting with Stochastic Interpolants and Föllmer Processes

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chen, Yifan, Goldstein, Mark, Hua, Mengjian, Albergo, Michael S., Boffi, Nicholas M., Vanden-Eijnden, Eric
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909298700845056
author Chen, Yifan
Goldstein, Mark
Hua, Mengjian
Albergo, Michael S.
Boffi, Nicholas M.
Vanden-Eijnden, Eric
author_facet Chen, Yifan
Goldstein, Mark
Hua, Mengjian
Albergo, Michael S.
Boffi, Nicholas M.
Vanden-Eijnden, Eric
contents We propose a framework for probabilistic forecasting of dynamical systems based on generative modeling. Given observations of the system state over time, we formulate the forecasting problem as sampling from the conditional distribution of the future system state given its current state. To this end, we leverage the framework of stochastic interpolants, which facilitates the construction of a generative model between an arbitrary base distribution and the target. We design a fictitious, non-physical stochastic dynamics that takes as initial condition the current system state and produces as output a sample from the target conditional distribution in finite time and without bias. This process therefore maps a point mass centered at the current state onto a probabilistic ensemble of forecasts. We prove that the drift coefficient entering the stochastic differential equation (SDE) achieving this task is non-singular, and that it can be learned efficiently by square loss regression over the time-series data. We show that the drift and the diffusion coefficients of this SDE can be adjusted after training, and that a specific choice that minimizes the impact of the estimation error gives a Föllmer process. We highlight the utility of our approach on several complex, high-dimensional forecasting problems, including stochastically forced Navier-Stokes and video prediction on the KTH and CLEVRER datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2403_13724
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Probabilistic Forecasting with Stochastic Interpolants and Föllmer Processes
Chen, Yifan
Goldstein, Mark
Hua, Mengjian
Albergo, Michael S.
Boffi, Nicholas M.
Vanden-Eijnden, Eric
Machine Learning
We propose a framework for probabilistic forecasting of dynamical systems based on generative modeling. Given observations of the system state over time, we formulate the forecasting problem as sampling from the conditional distribution of the future system state given its current state. To this end, we leverage the framework of stochastic interpolants, which facilitates the construction of a generative model between an arbitrary base distribution and the target. We design a fictitious, non-physical stochastic dynamics that takes as initial condition the current system state and produces as output a sample from the target conditional distribution in finite time and without bias. This process therefore maps a point mass centered at the current state onto a probabilistic ensemble of forecasts. We prove that the drift coefficient entering the stochastic differential equation (SDE) achieving this task is non-singular, and that it can be learned efficiently by square loss regression over the time-series data. We show that the drift and the diffusion coefficients of this SDE can be adjusted after training, and that a specific choice that minimizes the impact of the estimation error gives a Föllmer process. We highlight the utility of our approach on several complex, high-dimensional forecasting problems, including stochastically forced Navier-Stokes and video prediction on the KTH and CLEVRER datasets.
title Probabilistic Forecasting with Stochastic Interpolants and Föllmer Processes
topic Machine Learning
url https://arxiv.org/abs/2403.13724