Scalable Inference for Bayesian Multinomial Logistic-Normal Dynamic Linear Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Saxena, Manan, Chen, Tinghua, Silverman, Justin D.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913884024078336
author Saxena, Manan
Chen, Tinghua
Silverman, Justin D.
author_facet Saxena, Manan
Chen, Tinghua
Silverman, Justin D.
contents Many scientific fields collect longitudinal count compositional data. Each observation is a multivariate count vector, where the total counts are arbitrary, and the information lies in the relative frequency of the counts. Multiple authors have proposed Bayesian Multinomial Logistic-Normal Dynamic Linear Models (MLN-DLMs) as a flexible approach to modeling these data. However, adoption of these methods has been limited by computational challenges. This article develops an efficient and accurate approach to posterior state estimation, called $\textit{Fenrir}$. Our approach relies on a novel algorithm for MAP estimation and an accurate approximation to a key posterior marginal of the model. As there are no equivalent methods against which we can compare, we also develop an optimized Stan implementation of MLN-DLMs. Our experiments suggest that Fenrir can be three orders of magnitude more efficient than Stan and can even be incorporated into larger sampling schemes for joint inference of model hyperparameters. Our methods are made available to the community as a user-friendly software library written in C++ with an R interface.
format Preprint
id arxiv_https___arxiv_org_abs_2410_05548
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Scalable Inference for Bayesian Multinomial Logistic-Normal Dynamic Linear Models
Saxena, Manan
Chen, Tinghua
Silverman, Justin D.
Applications
Methodology
Machine Learning
Many scientific fields collect longitudinal count compositional data. Each observation is a multivariate count vector, where the total counts are arbitrary, and the information lies in the relative frequency of the counts. Multiple authors have proposed Bayesian Multinomial Logistic-Normal Dynamic Linear Models (MLN-DLMs) as a flexible approach to modeling these data. However, adoption of these methods has been limited by computational challenges. This article develops an efficient and accurate approach to posterior state estimation, called $\textit{Fenrir}$. Our approach relies on a novel algorithm for MAP estimation and an accurate approximation to a key posterior marginal of the model. As there are no equivalent methods against which we can compare, we also develop an optimized Stan implementation of MLN-DLMs. Our experiments suggest that Fenrir can be three orders of magnitude more efficient than Stan and can even be incorporated into larger sampling schemes for joint inference of model hyperparameters. Our methods are made available to the community as a user-friendly software library written in C++ with an R interface.
title Scalable Inference for Bayesian Multinomial Logistic-Normal Dynamic Linear Models
topic Applications
Methodology
Machine Learning
url https://arxiv.org/abs/2410.05548