Consistent information criteria for regularized regression and loss-based learning problems

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Qingyuan, Nguyen, Hien Duy
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917651434962944
author Zhang, Qingyuan
Nguyen, Hien Duy
author_facet Zhang, Qingyuan
Nguyen, Hien Duy
contents Many problems in statistics and machine learning can be formulated as model selection problems, where the goal is to choose an optimal parsimonious model among a set of candidate models. It is typical to conduct model selection by penalizing the objective function via information criteria (IC), as with the pioneering work by Akaike and Schwarz. Via recent work, we propose a generalized IC framework to consistently estimate general loss-based learning problems. In this work, we propose a consistent estimation method for Generalized Linear Model (GLM) regressions by utilizing the recent IC developments. We advance the generalized IC framework by proposing model selection problems, where the model set consists of a potentially uncountable set of models. In addition to theoretical expositions, our proposal introduces a computational procedure for the implementation of our methods in the finite sample setting, which we demonstrate via an extensive simulation study.
format Preprint
id arxiv_https___arxiv_org_abs_2404_17181
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Consistent information criteria for regularized regression and loss-based learning problems
Zhang, Qingyuan
Nguyen, Hien Duy
Methodology
Many problems in statistics and machine learning can be formulated as model selection problems, where the goal is to choose an optimal parsimonious model among a set of candidate models. It is typical to conduct model selection by penalizing the objective function via information criteria (IC), as with the pioneering work by Akaike and Schwarz. Via recent work, we propose a generalized IC framework to consistently estimate general loss-based learning problems. In this work, we propose a consistent estimation method for Generalized Linear Model (GLM) regressions by utilizing the recent IC developments. We advance the generalized IC framework by proposing model selection problems, where the model set consists of a potentially uncountable set of models. In addition to theoretical expositions, our proposal introduces a computational procedure for the implementation of our methods in the finite sample setting, which we demonstrate via an extensive simulation study.
title Consistent information criteria for regularized regression and loss-based learning problems
topic Methodology
url https://arxiv.org/abs/2404.17181