Constructing Variables Using Classifiers as an Aid to Regression: An Empirical Assessment

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Troisemaine, Colin, Lemaire, Vincent
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914712798625792
author Troisemaine, Colin
Lemaire, Vincent
author_facet Troisemaine, Colin
Lemaire, Vincent
contents This paper proposes a method for the automatic creation of variables (in the case of regression) that complement the information contained in the initial input vector. The method works as a pre-processing step in which the continuous values of the variable to be regressed are discretized into a set of intervals which are then used to define value thresholds. Then classifiers are trained to predict whether the value to be regressed is less than or equal to each of these thresholds. The different outputs of the classifiers are then concatenated in the form of an additional vector of variables that enriches the initial vector of the regression problem. The implemented system can thus be considered as a generic pre-processing tool. We tested the proposed enrichment method with 5 types of regressors and evaluated it in 33 regression datasets. Our experimental results confirm the interest of the approach.
format Preprint
id arxiv_https___arxiv_org_abs_2403_06829
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Constructing Variables Using Classifiers as an Aid to Regression: An Empirical Assessment
Troisemaine, Colin
Lemaire, Vincent
Machine Learning
This paper proposes a method for the automatic creation of variables (in the case of regression) that complement the information contained in the initial input vector. The method works as a pre-processing step in which the continuous values of the variable to be regressed are discretized into a set of intervals which are then used to define value thresholds. Then classifiers are trained to predict whether the value to be regressed is less than or equal to each of these thresholds. The different outputs of the classifiers are then concatenated in the form of an additional vector of variables that enriches the initial vector of the regression problem. The implemented system can thus be considered as a generic pre-processing tool. We tested the proposed enrichment method with 5 types of regressors and evaluated it in 33 regression datasets. Our experimental results confirm the interest of the approach.
title Constructing Variables Using Classifiers as an Aid to Regression: An Empirical Assessment
topic Machine Learning
url https://arxiv.org/abs/2403.06829