Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2020
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2011.14238 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929518748368896 |
|---|---|
| author | Zhang, Amy X. Bao, Le Li, Changcheng Daniels, Michael J. |
| author_facet | Zhang, Amy X. Bao, Le Li, Changcheng Daniels, Michael J. |
| contents | We introduce a novel procedure for obtaining cross-validated predictive estimates for Bayesian hierarchical regression models (BHRMs). Bayesian hierarchical models are popular for their ability to model complex dependence structures and provide probabilistic uncertainty estimates, but can be computationally expensive to run. Cross-validation (CV) is therefore not a common practice to evaluate the predictive performance of BHRMs. Our method circumvents the need to re-run computationally costly estimation methods for each cross-validation fold and makes CV more feasible for large BHRMs. By conditioning on the variance-covariance parameters, we shift the CV problem from probability-based sampling to a simple and familiar optimization problem. In many cases, this produces estimates which are equivalent to full CV. We provide theoretical results and demonstrate its efficacy on publicly available data and in simulations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2011_14238 |
| institution | arXiv |
| publishDate | 2020 |
| record_format | arxiv |
| spellingShingle | Approximate Cross-validated Mean Estimates for Bayesian Hierarchical Regression Models Zhang, Amy X. Bao, Le Li, Changcheng Daniels, Michael J. Machine Learning Computation We introduce a novel procedure for obtaining cross-validated predictive estimates for Bayesian hierarchical regression models (BHRMs). Bayesian hierarchical models are popular for their ability to model complex dependence structures and provide probabilistic uncertainty estimates, but can be computationally expensive to run. Cross-validation (CV) is therefore not a common practice to evaluate the predictive performance of BHRMs. Our method circumvents the need to re-run computationally costly estimation methods for each cross-validation fold and makes CV more feasible for large BHRMs. By conditioning on the variance-covariance parameters, we shift the CV problem from probability-based sampling to a simple and familiar optimization problem. In many cases, this produces estimates which are equivalent to full CV. We provide theoretical results and demonstrate its efficacy on publicly available data and in simulations. |
| title | Approximate Cross-validated Mean Estimates for Bayesian Hierarchical Regression Models |
| topic | Machine Learning Computation |
| url | https://arxiv.org/abs/2011.14238 |