Sequential Estimation of Gaussian Process-based Deep State-Space Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Yuhao, Ajirak, Marzieh, Djuric, Petar
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916172552732672
author Liu, Yuhao
Ajirak, Marzieh
Djuric, Petar
author_facet Liu, Yuhao
Ajirak, Marzieh
Djuric, Petar
contents We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian processes that are implemented via random feature-based Gaussian processes. In these models, we have two sets of unknowns, highly nonlinear unknowns (the values of the latent processes) and conditionally linear unknowns (the constant parameters of the random feature-based Gaussian processes). We present a method based on particle filtering where the parameters of the random feature-based Gaussian processes are integrated out in obtaining the predictive density of the states and do not need particles. We also propose an ensemble version of the method, with each member of the ensemble having its own set of features. With several experiments, we show that the method can track the latent processes up to a scale and rotation.
format Preprint
id arxiv_https___arxiv_org_abs_2301_12528
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Sequential Estimation of Gaussian Process-based Deep State-Space Models
Liu, Yuhao
Ajirak, Marzieh
Djuric, Petar
Machine Learning
We consider the problem of sequential estimation of the unknowns of state-space and deep state-space models that include estimation of functions and latent processes of the models. The proposed approach relies on Gaussian and deep Gaussian processes that are implemented via random feature-based Gaussian processes. In these models, we have two sets of unknowns, highly nonlinear unknowns (the values of the latent processes) and conditionally linear unknowns (the constant parameters of the random feature-based Gaussian processes). We present a method based on particle filtering where the parameters of the random feature-based Gaussian processes are integrated out in obtaining the predictive density of the states and do not need particles. We also propose an ensemble version of the method, with each member of the ensemble having its own set of features. With several experiments, we show that the method can track the latent processes up to a scale and rotation.
title Sequential Estimation of Gaussian Process-based Deep State-Space Models
topic Machine Learning
url https://arxiv.org/abs/2301.12528