Saved in:
Bibliographic Details
Main Author: Gilpin, Shay
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2508.16567
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918129135779840
author Gilpin, Shay
author_facet Gilpin, Shay
contents Modern data assimilation schemes typically use the same discrete dynamical model to evolve the state estimate in time also to approximate the evolution, or propagation, of the estimation error covariance. Ensemble-based methods, such as the ensemble Kalman filter, approximate the evolution of the covariance through the propagation of individual ensemble members. Thus, it is tacitly assumed that if the discrete state propagation and resulting mean state estimates are accurate, then the ensemble-based discrete covariance propagation will be accurate as well, apart from sampling errors due to limited ensemble size. Through a series of numerical experiments supported by analytical results, we demonstrate that this assumption is false when correlation length scales approach grid resolution. We show for states that satisfy advective dynamics, that while the discrete state propagation and ensemble mean state estimates are accurate, the corresponding ensemble covariances can be remarkably inaccurate, well beyond that expected from sampling errors or typical numerical discretization errors. The underlying problem is a fundamental discrepancy between discrete covariance propagation and the continuum covariance dynamics, which we can identify because the exact continuum covariance dynamics are known. Errors in the ensemble covariances, which can be at least one order of magnitude larger than those of the mean state when correlation lengths begin to approach grid scale, cannot be rectified by the usual methods, such as covariance inflation and localization. This work brings to light a fundamental problem for data assimilation schemes that propagate covariances using the same discrete dynamical model used to propagate the state.
format Preprint
id arxiv_https___arxiv_org_abs_2508_16567
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Inaccuracy of Ensemble-Based Covariance Propagation, Beyond Sampling Error
Gilpin, Shay
Analysis of PDEs
Numerical Analysis
Modern data assimilation schemes typically use the same discrete dynamical model to evolve the state estimate in time also to approximate the evolution, or propagation, of the estimation error covariance. Ensemble-based methods, such as the ensemble Kalman filter, approximate the evolution of the covariance through the propagation of individual ensemble members. Thus, it is tacitly assumed that if the discrete state propagation and resulting mean state estimates are accurate, then the ensemble-based discrete covariance propagation will be accurate as well, apart from sampling errors due to limited ensemble size. Through a series of numerical experiments supported by analytical results, we demonstrate that this assumption is false when correlation length scales approach grid resolution. We show for states that satisfy advective dynamics, that while the discrete state propagation and ensemble mean state estimates are accurate, the corresponding ensemble covariances can be remarkably inaccurate, well beyond that expected from sampling errors or typical numerical discretization errors. The underlying problem is a fundamental discrepancy between discrete covariance propagation and the continuum covariance dynamics, which we can identify because the exact continuum covariance dynamics are known. Errors in the ensemble covariances, which can be at least one order of magnitude larger than those of the mean state when correlation lengths begin to approach grid scale, cannot be rectified by the usual methods, such as covariance inflation and localization. This work brings to light a fundamental problem for data assimilation schemes that propagate covariances using the same discrete dynamical model used to propagate the state.
title Inaccuracy of Ensemble-Based Covariance Propagation, Beyond Sampling Error
topic Analysis of PDEs
Numerical Analysis
url https://arxiv.org/abs/2508.16567