A Random-effects Approach to Regression Involving Many Categorical Predictors and Their Interactions
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913500211707904 |
|---|---|
| author | Sun, Hanmei Zhang, Jiangshan Jiang, Jiming |
| author_facet | Sun, Hanmei Zhang, Jiangshan Jiang, Jiming |
| contents | Linear model prediction with a large number of potential predictors is both statistically and computationally challenging. The traditional approaches are largely based on shrinkage selection/estimation methods, which are applicable even when the number of potential predictors is (much) larger than the sample size. A situation of the latter scenario occurs when the candidate predictors involve many binary indicators corresponding to categories of some categorical predictors as well as their interactions. We propose an alternative approach to the shrinkage prediction methods in such a case based on mixed model prediction, which effectively treats combinations of the categorical effects as random effects. We establish theoretical validity of the proposed method, and demonstrate empirically its advantage over the shrinkage methods. We also develop measures of uncertainty for the proposed method and evaluate their performance empirically. A real-data example is considered. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_09355 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Random-effects Approach to Regression Involving Many Categorical Predictors and Their Interactions Sun, Hanmei Zhang, Jiangshan Jiang, Jiming Methodology Statistics Theory Linear model prediction with a large number of potential predictors is both statistically and computationally challenging. The traditional approaches are largely based on shrinkage selection/estimation methods, which are applicable even when the number of potential predictors is (much) larger than the sample size. A situation of the latter scenario occurs when the candidate predictors involve many binary indicators corresponding to categories of some categorical predictors as well as their interactions. We propose an alternative approach to the shrinkage prediction methods in such a case based on mixed model prediction, which effectively treats combinations of the categorical effects as random effects. We establish theoretical validity of the proposed method, and demonstrate empirically its advantage over the shrinkage methods. We also develop measures of uncertainty for the proposed method and evaluate their performance empirically. A real-data example is considered. |
| title | A Random-effects Approach to Regression Involving Many Categorical Predictors and Their Interactions |
| topic | Methodology Statistics Theory |
| url | https://arxiv.org/abs/2409.09355 |