Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2510.09598 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915858217959424 |
|---|---|
| author | Linero, Antonio R. |
| author_facet | Linero, Antonio R. |
| contents | Some applied researchers hesitate to use nonparametric methods, worrying that they will lose power in small samples or overfit the data when simpler models are sufficient. We argue that at least some of these concerns are unfounded when nonparametric models are strongly shrunk toward parametric submodels. We consider expanding a parametric model with a nonparametric component $r(x)$ that is heavily shrunk toward zero. This construction allows the model to adapt automatically: if the parametric model is correct, the nonparametric component disappears, recovering parametric efficiency, while if it is misspecified, the flexible component activates to capture the missing signal. We show that this adaptive behavior follows from simple and general conditions. Specifically, we prove that Bayesian nonparametric models anchored to linear regression, including variants of Gaussian process regression and Bayesian additive regression trees, consistently identify the correct parametric submodel when it holds and give asymptotically efficient inference for regression coefficients. In simulations, we find that the general BART model performs identically to correctly specified linear regression when the parametric model holds, and substantially outperforms it when nonlinear effects are present. This suggests a practical paradigm: defensive model expansion as a safeguard against model misspecification. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_09598 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Defensive Model Expansion for Robust Bayesian Inference Linero, Antonio R. Methodology Some applied researchers hesitate to use nonparametric methods, worrying that they will lose power in small samples or overfit the data when simpler models are sufficient. We argue that at least some of these concerns are unfounded when nonparametric models are strongly shrunk toward parametric submodels. We consider expanding a parametric model with a nonparametric component $r(x)$ that is heavily shrunk toward zero. This construction allows the model to adapt automatically: if the parametric model is correct, the nonparametric component disappears, recovering parametric efficiency, while if it is misspecified, the flexible component activates to capture the missing signal. We show that this adaptive behavior follows from simple and general conditions. Specifically, we prove that Bayesian nonparametric models anchored to linear regression, including variants of Gaussian process regression and Bayesian additive regression trees, consistently identify the correct parametric submodel when it holds and give asymptotically efficient inference for regression coefficients. In simulations, we find that the general BART model performs identically to correctly specified linear regression when the parametric model holds, and substantially outperforms it when nonlinear effects are present. This suggests a practical paradigm: defensive model expansion as a safeguard against model misspecification. |
| title | Defensive Model Expansion for Robust Bayesian Inference |
| topic | Methodology |
| url | https://arxiv.org/abs/2510.09598 |