A comparison between initialization strategies for the infinite hidden Markov model

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cortese, Federico P., Rossini, Luca
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915651532095488
author Cortese, Federico P.
Rossini, Luca
author_facet Cortese, Federico P.
Rossini, Luca
contents Infinite hidden Markov models provide a flexible framework for modelling time series with structural changes and complex dynamics, without requiring the number of latent states to be specified in advance. This flexibility is achieved through the hierarchical Dirichlet process prior, while efficient Bayesian inference is enabled by the beam sampler, which combines dynamic programming with slice sampling to truncate the infinite state space adaptively. Despite extensive methodological developments, the role of initialization in this framework has received limited attention. This study addresses this gap by systematically evaluating initialization strategies commonly used for finite hidden Markov models and assessing their suitability in the infinite setting. Results from both simulated and real datasets show that distance-based clustering initializations consistently outperform model-based and uniform alternatives, the latter being the most widely adopted in the existing literature.
format Preprint
id arxiv_https___arxiv_org_abs_2512_03777
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A comparison between initialization strategies for the infinite hidden Markov model
Cortese, Federico P.
Rossini, Luca
Methodology
Applications
Machine Learning
37M10, 62H30, 62C10, 62F15, 62M05
Infinite hidden Markov models provide a flexible framework for modelling time series with structural changes and complex dynamics, without requiring the number of latent states to be specified in advance. This flexibility is achieved through the hierarchical Dirichlet process prior, while efficient Bayesian inference is enabled by the beam sampler, which combines dynamic programming with slice sampling to truncate the infinite state space adaptively. Despite extensive methodological developments, the role of initialization in this framework has received limited attention. This study addresses this gap by systematically evaluating initialization strategies commonly used for finite hidden Markov models and assessing their suitability in the infinite setting. Results from both simulated and real datasets show that distance-based clustering initializations consistently outperform model-based and uniform alternatives, the latter being the most widely adopted in the existing literature.
title A comparison between initialization strategies for the infinite hidden Markov model
topic Methodology
Applications
Machine Learning
37M10, 62H30, 62C10, 62F15, 62M05
url https://arxiv.org/abs/2512.03777