Numerical study of high-dimensional covariance estimation and localization for data assimilation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Gilpin, Shay, Morzfeld, Matthias, Lin, Kevin K.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909752701747200
author Gilpin, Shay
Morzfeld, Matthias
Lin, Kevin K.
author_facet Gilpin, Shay
Morzfeld, Matthias
Lin, Kevin K.
contents Covariance localization is a critical component of ensemble-based data assimilation (DA) and many current localization schemes simply dampen correlations as a function of distance. Increases in computational resources, broadening scope of application for DA, and advances in general statistical methodology raise the question as to whether alternative localization methods may improve ensemble DA relative to current schemes. We carefully explore this issue by comparing distance based localization with alternative covariance localization techniques, partially those taken from the statistical literature. The comparison is done on test problems that we designed to challenge distance-based localization, including joint state-parameter estimation in a modified Lorenz '96 model and state estimation in a two-layer quasi-geostrophic model. Across all sets of experiments, we find that while localization of any kind (with rare exceptions) can lead to significant reductions in error, traditional, distance-based localization generally leads to the largest error reduction. More general localization schemes can sometimes lead to greater error reduction, though the impacts may only be marginal and may require more tuning and/or prior information.
format Preprint
id arxiv_https___arxiv_org_abs_2508_18299
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Numerical study of high-dimensional covariance estimation and localization for data assimilation
Gilpin, Shay
Morzfeld, Matthias
Lin, Kevin K.
Data Analysis, Statistics and Probability
Covariance localization is a critical component of ensemble-based data assimilation (DA) and many current localization schemes simply dampen correlations as a function of distance. Increases in computational resources, broadening scope of application for DA, and advances in general statistical methodology raise the question as to whether alternative localization methods may improve ensemble DA relative to current schemes. We carefully explore this issue by comparing distance based localization with alternative covariance localization techniques, partially those taken from the statistical literature. The comparison is done on test problems that we designed to challenge distance-based localization, including joint state-parameter estimation in a modified Lorenz '96 model and state estimation in a two-layer quasi-geostrophic model. Across all sets of experiments, we find that while localization of any kind (with rare exceptions) can lead to significant reductions in error, traditional, distance-based localization generally leads to the largest error reduction. More general localization schemes can sometimes lead to greater error reduction, though the impacts may only be marginal and may require more tuning and/or prior information.
title Numerical study of high-dimensional covariance estimation and localization for data assimilation
topic Data Analysis, Statistics and Probability
url https://arxiv.org/abs/2508.18299