Differentiable Interacting Multiple Model Particle Filtering

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Brady, John-Joseph, Luo, Yuhui, Wang, Wenwu, Elvira, Víctor, Li, Yunpeng
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910751134842880
author Brady, John-Joseph
Luo, Yuhui
Wang, Wenwu
Elvira, Víctor
Li, Yunpeng
author_facet Brady, John-Joseph
Luo, Yuhui
Wang, Wenwu
Elvira, Víctor
Li, Yunpeng
contents We propose a sequential Monte Carlo algorithm for parameter learning when the studied model exhibits random discontinuous jumps in behaviour. To facilitate the learning of high dimensional parameter sets, such as those associated to neural networks, we adopt the emerging framework of differentiable particle filtering, wherein parameters are trained by gradient descent. We design a new differentiable interacting multiple model particle filter to be capable of learning the individual behavioural regimes and the model which controls the jumping simultaneously. In contrast to previous approaches, our algorithm allows control of the computational effort assigned per regime whilst using the probability of being in a given regime to guide sampling. Furthermore, we develop a new gradient estimator that has a lower variance than established approaches and remains fast to compute, for which we prove consistency. We establish new theoretical results of the presented algorithms and demonstrate superior numerical performance compared to the previous state-of-the-art algorithms.
format Preprint
id arxiv_https___arxiv_org_abs_2410_00620
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Differentiable Interacting Multiple Model Particle Filtering
Brady, John-Joseph
Luo, Yuhui
Wang, Wenwu
Elvira, Víctor
Li, Yunpeng
Machine Learning
Signal Processing
62M20, 62F12
We propose a sequential Monte Carlo algorithm for parameter learning when the studied model exhibits random discontinuous jumps in behaviour. To facilitate the learning of high dimensional parameter sets, such as those associated to neural networks, we adopt the emerging framework of differentiable particle filtering, wherein parameters are trained by gradient descent. We design a new differentiable interacting multiple model particle filter to be capable of learning the individual behavioural regimes and the model which controls the jumping simultaneously. In contrast to previous approaches, our algorithm allows control of the computational effort assigned per regime whilst using the probability of being in a given regime to guide sampling. Furthermore, we develop a new gradient estimator that has a lower variance than established approaches and remains fast to compute, for which we prove consistency. We establish new theoretical results of the presented algorithms and demonstrate superior numerical performance compared to the previous state-of-the-art algorithms.
title Differentiable Interacting Multiple Model Particle Filtering
topic Machine Learning
Signal Processing
62M20, 62F12
url https://arxiv.org/abs/2410.00620