The Generalized Elastic Net for least squares regression with network-aligned signal and correlated design
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915532774572032 |
|---|---|
| author | Tran, Huy Wei, Sansen Donnat, Claire |
| author_facet | Tran, Huy Wei, Sansen Donnat, Claire |
| contents | We propose a novel $\ell_1+\ell_2$-penalty, which we refer to as the Generalized Elastic Net, for regression problems where the feature vectors are indexed by vertices of a given graph and the true signal is believed to be smooth or piecewise constant with respect to this graph. Under the assumption of correlated Gaussian design, we derive upper bounds for the prediction and estimation errors, which are graph-dependent and consist of a parametric rate for the unpenalized portion of the regression vector and another term that depends on our network alignment assumption. We also provide a coordinate descent procedure based on the Lagrange dual objective to compute this estimator for large-scale problems. Finally, we compare our proposed estimator to existing regularized estimators on a number of real and synthetic datasets and discuss its potential limitations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2211_00292 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | The Generalized Elastic Net for least squares regression with network-aligned signal and correlated design Tran, Huy Wei, Sansen Donnat, Claire Methodology Statistics Theory 62J05, 62J07 We propose a novel $\ell_1+\ell_2$-penalty, which we refer to as the Generalized Elastic Net, for regression problems where the feature vectors are indexed by vertices of a given graph and the true signal is believed to be smooth or piecewise constant with respect to this graph. Under the assumption of correlated Gaussian design, we derive upper bounds for the prediction and estimation errors, which are graph-dependent and consist of a parametric rate for the unpenalized portion of the regression vector and another term that depends on our network alignment assumption. We also provide a coordinate descent procedure based on the Lagrange dual objective to compute this estimator for large-scale problems. Finally, we compare our proposed estimator to existing regularized estimators on a number of real and synthetic datasets and discuss its potential limitations. |
| title | The Generalized Elastic Net for least squares regression with network-aligned signal and correlated design |
| topic | Methodology Statistics Theory 62J05, 62J07 |
| url | https://arxiv.org/abs/2211.00292 |