Hamiltonian Monte Carlo for Regression with High-Dimensional Categorical Data
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2021
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910348801474560 |
|---|---|
| author | Sacher, Szymon Battaglia, Laura Hansen, Stephen |
| author_facet | Sacher, Szymon Battaglia, Laura Hansen, Stephen |
| contents | Latent variable models are increasingly used in economics for high-dimensional categorical data like text and surveys. We demonstrate the effectiveness of Hamiltonian Monte Carlo (HMC) with parallelized automatic differentiation for analyzing such data in a computationally efficient and methodologically sound manner. Our new model, Supervised Topic Model with Covariates, shows that carefully modeling this type of data can have significant implications on conclusions compared to a simpler, frequently used, yet methodologically problematic, two-step approach. A simulation study and revisiting Bandiera et al. (2020)'s study of executive time use demonstrate these results. The approach accommodates thousands of parameters and doesn't require custom algorithms specific to each model, making it accessible for applied researchers |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2107_08112 |
| institution | arXiv |
| publishDate | 2021 |
| record_format | arxiv |
| spellingShingle | Hamiltonian Monte Carlo for Regression with High-Dimensional Categorical Data Sacher, Szymon Battaglia, Laura Hansen, Stephen Econometrics Methodology Latent variable models are increasingly used in economics for high-dimensional categorical data like text and surveys. We demonstrate the effectiveness of Hamiltonian Monte Carlo (HMC) with parallelized automatic differentiation for analyzing such data in a computationally efficient and methodologically sound manner. Our new model, Supervised Topic Model with Covariates, shows that carefully modeling this type of data can have significant implications on conclusions compared to a simpler, frequently used, yet methodologically problematic, two-step approach. A simulation study and revisiting Bandiera et al. (2020)'s study of executive time use demonstrate these results. The approach accommodates thousands of parameters and doesn't require custom algorithms specific to each model, making it accessible for applied researchers |
| title | Hamiltonian Monte Carlo for Regression with High-Dimensional Categorical Data |
| topic | Econometrics Methodology |
| url | https://arxiv.org/abs/2107.08112 |