Dealing with separation problem in hidden Markov models with covariates based on a penalized maximum likelihood approach
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908431674245120 |
|---|---|
| author | Brusa, Luca Pennoni, Fulvia Bartolucci, Francesco Bagolini, Romina Peruilh |
| author_facet | Brusa, Luca Pennoni, Fulvia Bartolucci, Francesco Bagolini, Romina Peruilh |
| contents | A penalized maximum likelihood estimation approach is proposed for discrete-time hidden Markov models where covariates affect the observed responses and serial dependence is considered. The proposed penalized maximum likelihood method addresses the issue of latent state separation that typically occurs when this model is applied to binary and categorical response variables with a limited number of categories, resulting in extremely large estimates of the support points of the latent variable assumed with a discrete, left unspecified distribution. We also propose a cross-validation approach for jointly selecting the number of hidden states and the roughness of the penalty term. The proposal is illustrated through a simulation study comparing parameter estimation accuracy and computational efficiency across different estimation procedures. We also demonstrate the potential of this class of models through the analysis of longitudinal data collected during spinal anesthesia to monitor the occurrence of hypotension in patients, and we compare the results with those obtained from other standard models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_02425 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Dealing with separation problem in hidden Markov models with covariates based on a penalized maximum likelihood approach Brusa, Luca Pennoni, Fulvia Bartolucci, Francesco Bagolini, Romina Peruilh Methodology A penalized maximum likelihood estimation approach is proposed for discrete-time hidden Markov models where covariates affect the observed responses and serial dependence is considered. The proposed penalized maximum likelihood method addresses the issue of latent state separation that typically occurs when this model is applied to binary and categorical response variables with a limited number of categories, resulting in extremely large estimates of the support points of the latent variable assumed with a discrete, left unspecified distribution. We also propose a cross-validation approach for jointly selecting the number of hidden states and the roughness of the penalty term. The proposal is illustrated through a simulation study comparing parameter estimation accuracy and computational efficiency across different estimation procedures. We also demonstrate the potential of this class of models through the analysis of longitudinal data collected during spinal anesthesia to monitor the occurrence of hypotension in patients, and we compare the results with those obtained from other standard models. |
| title | Dealing with separation problem in hidden Markov models with covariates based on a penalized maximum likelihood approach |
| topic | Methodology |
| url | https://arxiv.org/abs/2507.02425 |