Computation-Aware Kalman Filtering and Smoothing

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Pförtner, Marvin, Wenger, Jonathan, Cockayne, Jon, Hennig, Philipp
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912270429192192
author Pförtner, Marvin
Wenger, Jonathan
Cockayne, Jon
Hennig, Philipp
author_facet Pförtner, Marvin
Wenger, Jonathan
Cockayne, Jon
Hennig, Philipp
contents Kalman filtering and smoothing are the foundational mechanisms for efficient inference in Gauss-Markov models. However, their time and memory complexities scale prohibitively with the size of the state space. This is particularly problematic in spatiotemporal regression problems, where the state dimension scales with the number of spatial observations. Existing approximate frameworks leverage low-rank approximations of the covariance matrix. But since they do not model the error introduced by the computational approximation, their predictive uncertainty estimates can be overly optimistic. In this work, we propose a probabilistic numerical method for inference in high-dimensional Gauss-Markov models which mitigates these scaling issues. Our matrix-free iterative algorithm leverages GPU acceleration and crucially enables a tunable trade-off between computational cost and predictive uncertainty. Finally, we demonstrate the scalability of our method on a large-scale climate dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2405_08971
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Computation-Aware Kalman Filtering and Smoothing
Pförtner, Marvin
Wenger, Jonathan
Cockayne, Jon
Hennig, Philipp
Machine Learning
Numerical Analysis
Kalman filtering and smoothing are the foundational mechanisms for efficient inference in Gauss-Markov models. However, their time and memory complexities scale prohibitively with the size of the state space. This is particularly problematic in spatiotemporal regression problems, where the state dimension scales with the number of spatial observations. Existing approximate frameworks leverage low-rank approximations of the covariance matrix. But since they do not model the error introduced by the computational approximation, their predictive uncertainty estimates can be overly optimistic. In this work, we propose a probabilistic numerical method for inference in high-dimensional Gauss-Markov models which mitigates these scaling issues. Our matrix-free iterative algorithm leverages GPU acceleration and crucially enables a tunable trade-off between computational cost and predictive uncertainty. Finally, we demonstrate the scalability of our method on a large-scale climate dataset.
title Computation-Aware Kalman Filtering and Smoothing
topic Machine Learning
Numerical Analysis
url https://arxiv.org/abs/2405.08971