Comparison of Regression Methods with Non-Convex Penalties
Fuente:
Zenodo
Guardado en:
| Autor principal: | |
|---|---|
| Formato: | Recurso digital |
| Publicado: |
Zenodo
2019
|
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866901183067586560 |
|---|---|
| author | Pipher, Brandon P. |
| author_facet | Pipher, Brandon P. |
| contents | <p>We examine a solution to the problem of sparse selection in linear models. The method used is a mixed norm ℓp-ℓq algorithm with a focus on non-convex, q < 1, penalty parameters. Classical regression, Ordinary Least Squares, has low bias but high variance and prediction accuracy can sometimes be improved by increasing bias to decrease variance. By inducing sparsity we can improve model interpretability, especially in the setting of high-dimensional data. These methods of penalized regression also provide solutions when the Ordinary Least Squares solution is ill-posed under a high-dimensional setting, and have a history of producing accurate and parsimonious models. A simulation study is conducted utilizing another method of penalized regression using non-convex penalties, the SparseNet algorithm, which had previously been compared independently against several other proposed sparsity inducing non-convex solutions. We also include a comparison with other more common penalties such as LASSO, Ridge/Tikhonov, and Elastic Net.</p> |
| format | Recurso digital |
| id | zenodo_https___doi_org_10_5281_zenodo_14009815 |
| institution | Zenodo |
| language | |
| publishDate | 2019 |
| publisher | Zenodo |
| record_format | zenodo |
| spellingShingle | Comparison of Regression Methods with Non-Convex Penalties Pipher, Brandon P. <p>We examine a solution to the problem of sparse selection in linear models. The method used is a mixed norm ℓp-ℓq algorithm with a focus on non-convex, q < 1, penalty parameters. Classical regression, Ordinary Least Squares, has low bias but high variance and prediction accuracy can sometimes be improved by increasing bias to decrease variance. By inducing sparsity we can improve model interpretability, especially in the setting of high-dimensional data. These methods of penalized regression also provide solutions when the Ordinary Least Squares solution is ill-posed under a high-dimensional setting, and have a history of producing accurate and parsimonious models. A simulation study is conducted utilizing another method of penalized regression using non-convex penalties, the SparseNet algorithm, which had previously been compared independently against several other proposed sparsity inducing non-convex solutions. We also include a comparison with other more common penalties such as LASSO, Ridge/Tikhonov, and Elastic Net.</p> |
| title | Comparison of Regression Methods with Non-Convex Penalties |
| url | https://doi.org/10.5281/zenodo.14009815 |