Saved in:
Bibliographic Details
Main Authors: Cox, Benjamin, Segarra, Santiago, Elvira, Victor
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2411.15638
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908285462904832
author Cox, Benjamin
Segarra, Santiago
Elvira, Victor
author_facet Cox, Benjamin
Segarra, Santiago
Elvira, Victor
contents State-space models are a popular statistical framework for analysing sequential data. Within this framework, particle filters are often used to perform inference on non-linear state-space models. We introduce a new method, StateMixNN, that uses a pair of neural networks to learn the proposal distribution and transition distribution of a particle filter. Both distributions are approximated using multivariate Gaussian mixtures. The component means and covariances of these mixtures are learnt as outputs of learned functions. Our method is trained targeting the log-likelihood, thereby requiring only the observation series, and combines the interpretability of state-space models with the flexibility and approximation power of artificial neural networks. The proposed method significantly improves recovery of the hidden state in comparison with the state-of-the-art, showing greater improvement in highly non-linear scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2411_15638
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Learning state and proposal dynamics in state-space models using differentiable particle filters and neural networks
Cox, Benjamin
Segarra, Santiago
Elvira, Victor
Machine Learning
Computation
State-space models are a popular statistical framework for analysing sequential data. Within this framework, particle filters are often used to perform inference on non-linear state-space models. We introduce a new method, StateMixNN, that uses a pair of neural networks to learn the proposal distribution and transition distribution of a particle filter. Both distributions are approximated using multivariate Gaussian mixtures. The component means and covariances of these mixtures are learnt as outputs of learned functions. Our method is trained targeting the log-likelihood, thereby requiring only the observation series, and combines the interpretability of state-space models with the flexibility and approximation power of artificial neural networks. The proposed method significantly improves recovery of the hidden state in comparison with the state-of-the-art, showing greater improvement in highly non-linear scenarios.
title Learning state and proposal dynamics in state-space models using differentiable particle filters and neural networks
topic Machine Learning
Computation
url https://arxiv.org/abs/2411.15638