A kernel-based framework for covariate significance tests in nonparametric regression
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916747795234816 |
|---|---|
| author | Diz-Castro, Daniel Febrero-Bande, Manuel González-Manteiga, Wenceslao |
| author_facet | Diz-Castro, Daniel Febrero-Bande, Manuel González-Manteiga, Wenceslao |
| contents | It is well known that nonparametric regression estimation and inference procedures are subject to the curse of dimensionality. Moreover, model interpretability usually decreases with the data dimension. Therefore, model-free variable selection procedures and, in particular, covariate significance tests, are invaluable tools for regression modelling as they help to remove irrelevant covariates. In this contribution, we provide a general framework, based on recent developments in the theory of kernel-based characterizations of null conditional expectations, for testing the significance of a subgroup of Hilbert space-valued covariates in a nonparametric regression model. Moreover, we propose a test designed to be robust against the curse of dimensionality and we provide some asymptotic results regarding the distribution of the test statistic under the null hypothesis of non-significant covariates as well as under fixed and local alternatives. Regarding the test calibration, we present and prove the consistency of a multiplier bootstrap scheme. An extensive simulation study is conducted to assess the finite sample performance of the test. We also apply our test in a real data scenario |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2505_14851 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | A kernel-based framework for covariate significance tests in nonparametric regression Diz-Castro, Daniel Febrero-Bande, Manuel González-Manteiga, Wenceslao Methodology 62G10 (Primary) 62G08, 62G09, 62G20 (Secondary) It is well known that nonparametric regression estimation and inference procedures are subject to the curse of dimensionality. Moreover, model interpretability usually decreases with the data dimension. Therefore, model-free variable selection procedures and, in particular, covariate significance tests, are invaluable tools for regression modelling as they help to remove irrelevant covariates. In this contribution, we provide a general framework, based on recent developments in the theory of kernel-based characterizations of null conditional expectations, for testing the significance of a subgroup of Hilbert space-valued covariates in a nonparametric regression model. Moreover, we propose a test designed to be robust against the curse of dimensionality and we provide some asymptotic results regarding the distribution of the test statistic under the null hypothesis of non-significant covariates as well as under fixed and local alternatives. Regarding the test calibration, we present and prove the consistency of a multiplier bootstrap scheme. An extensive simulation study is conducted to assess the finite sample performance of the test. We also apply our test in a real data scenario |
| title | A kernel-based framework for covariate significance tests in nonparametric regression |
| topic | Methodology 62G10 (Primary) 62G08, 62G09, 62G20 (Secondary) |
| url | https://arxiv.org/abs/2505.14851 |