Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2212.12954 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916606932680704 |
|---|---|
| author | Chen, Juntong |
| author_facet | Chen, Juntong |
| contents | We observe $n$ independent pairs of random variables $(W_{i}, Y_{i})$, where the conditional distribution of $Y_{i}$ given $W_{i}=w_{i}$ follows a one-parameter exponential family with parameter $\bsg^{*}(w_{i})\in\R$. Our goal is to estimate the regression function $\bsg^{*}$. We start with an arbitrary collection of piecewise constant candidate estimators based on our observations and, using the same data, select an estimator from this collection. Our approach is agnostic to the dependencies of the candidate estimators on the data, differing from methods like data splitting, cross-validation, and hold-out. To demonstrate its theoretical performance, we provide a non-asymptotic risk bound for the selected estimator. We then explain how to apply the procedure to changepoint detection in exponential families. The practical performance of the proposed approach is illustrated through a comparative simulation study under different scenarios and real datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2212_12954 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Non-Data-Splitting Estimator Selection for Regression in Exponential Families Chen, Juntong Methodology We observe $n$ independent pairs of random variables $(W_{i}, Y_{i})$, where the conditional distribution of $Y_{i}$ given $W_{i}=w_{i}$ follows a one-parameter exponential family with parameter $\bsg^{*}(w_{i})\in\R$. Our goal is to estimate the regression function $\bsg^{*}$. We start with an arbitrary collection of piecewise constant candidate estimators based on our observations and, using the same data, select an estimator from this collection. Our approach is agnostic to the dependencies of the candidate estimators on the data, differing from methods like data splitting, cross-validation, and hold-out. To demonstrate its theoretical performance, we provide a non-asymptotic risk bound for the selected estimator. We then explain how to apply the procedure to changepoint detection in exponential families. The practical performance of the proposed approach is illustrated through a comparative simulation study under different scenarios and real datasets. |
| title | Non-Data-Splitting Estimator Selection for Regression in Exponential Families |
| topic | Methodology |
| url | https://arxiv.org/abs/2212.12954 |