From Model Selection to Model Averaging: A Comparison for Nested Linear Models
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2022
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866916565934407680 |
|---|---|
| author | Xu, Wenchao Zhang, Xinyu |
| author_facet | Xu, Wenchao Zhang, Xinyu |
| contents | Model selection (MS) and model averaging (MA) are two popular approaches when having many candidate models. Theoretically, the estimation risk of an oracle MA is not larger than that of an oracle MS because the former one is more flexible, but a foundational issue is: does MA offer a {\it substantial} improvement over MS? Recently, a seminal work: Peng and Yang (2021), has answered this question under nested models with linear orthonormal series expansion. In the current paper, we further reply this question under linear nested regression models. Especially, a more general nested framework, heteroscedastic and autocorrelated random errors, and sparse coefficients are allowed in the current paper, which is more common in practice. In addition, we further compare MAs with different weight sets. Simulation studies support the theoretical findings in a variety of settings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2202_11978 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | From Model Selection to Model Averaging: A Comparison for Nested Linear Models Xu, Wenchao Zhang, Xinyu Statistics Theory Model selection (MS) and model averaging (MA) are two popular approaches when having many candidate models. Theoretically, the estimation risk of an oracle MA is not larger than that of an oracle MS because the former one is more flexible, but a foundational issue is: does MA offer a {\it substantial} improvement over MS? Recently, a seminal work: Peng and Yang (2021), has answered this question under nested models with linear orthonormal series expansion. In the current paper, we further reply this question under linear nested regression models. Especially, a more general nested framework, heteroscedastic and autocorrelated random errors, and sparse coefficients are allowed in the current paper, which is more common in practice. In addition, we further compare MAs with different weight sets. Simulation studies support the theoretical findings in a variety of settings. |
| title | From Model Selection to Model Averaging: A Comparison for Nested Linear Models |
| topic | Statistics Theory |
| url | https://arxiv.org/abs/2202.11978 |