Saved in:
Bibliographic Details
Main Authors: Trappler, Victor, Vidard, Arthur
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2501.04369
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913640596111360
author Trappler, Victor
Vidard, Arthur
author_facet Trappler, Victor
Vidard, Arthur
contents Data Assimilation is the process in which we improve the representation of the state of a physical system by combining information coming from a numerical model, real-world observations, and some prior modelling. It is widely used to model and to improve forecast systems in Earth science fields such as meteorology, oceanography and environmental sciences. One key aspect of Data assimilation is the analysis step, where the output of the numerical model is adjusted in order to account for the observational data. In Variational Data Assimilation and under Gaussian assumptions, the analysis step comes down to solving a high-dimensional non-linear least-square problem. In practice, this minimization involves successive inversions of large, and possibly ill-conditioned matrices constructed using linearizations of the forward model. In order to improve the convergence rate of these methods, and thus reduce the computational burden, preconditioning techniques are often used to get better-conditioned matrices, but require either the sparsity pattern of the matrix to inverse, or some spectral information. We propose to use Deep Neural Networks in order to construct a preconditioner. This surrogate is trained using some properties of the singular value decomposition, and is based on a dataset which can be constructed online to reduce the storage requirements.
format Preprint
id arxiv_https___arxiv_org_abs_2501_04369
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle State-dependent preconditioning for the inner-loop in Variational Data Assimilation using Machine Learning
Trappler, Victor
Vidard, Arthur
Optimization and Control
Data Assimilation is the process in which we improve the representation of the state of a physical system by combining information coming from a numerical model, real-world observations, and some prior modelling. It is widely used to model and to improve forecast systems in Earth science fields such as meteorology, oceanography and environmental sciences. One key aspect of Data assimilation is the analysis step, where the output of the numerical model is adjusted in order to account for the observational data. In Variational Data Assimilation and under Gaussian assumptions, the analysis step comes down to solving a high-dimensional non-linear least-square problem. In practice, this minimization involves successive inversions of large, and possibly ill-conditioned matrices constructed using linearizations of the forward model. In order to improve the convergence rate of these methods, and thus reduce the computational burden, preconditioning techniques are often used to get better-conditioned matrices, but require either the sparsity pattern of the matrix to inverse, or some spectral information. We propose to use Deep Neural Networks in order to construct a preconditioner. This surrogate is trained using some properties of the singular value decomposition, and is based on a dataset which can be constructed online to reduce the storage requirements.
title State-dependent preconditioning for the inner-loop in Variational Data Assimilation using Machine Learning
topic Optimization and Control
url https://arxiv.org/abs/2501.04369