Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cerqua, Augusto, Letta, Marco, Pinto, Gabriele
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2411.09218
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915272101724160
author Cerqua, Augusto
Letta, Marco
Pinto, Gabriele
author_facet Cerqua, Augusto
Letta, Marco
Pinto, Gabriele
contents We provide the first systematic assessment of data leakage issues in the use of machine learning on panel data. Our organizing framework clarifies why neglecting the cross-sectional and longitudinal structure of these data leads to hard-to-detect data leakage, inflated out-of-sample performance, and an inadvertent overestimation of the real-world usefulness and applicability of machine learning models. We then offer empirical guidelines for practitioners to ensure the correct implementation of supervised machine learning in panel data environments. An empirical application, using data from over 3,000 U.S. counties spanning 2000-2019 and focused on income prediction, illustrates the practical relevance of these points across nearly 500 models for both classification and regression tasks.
format Preprint
id arxiv_https___arxiv_org_abs_2411_09218
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On the (Mis)Use of Machine Learning with Panel Data
Cerqua, Augusto
Letta, Marco
Pinto, Gabriele
Econometrics
We provide the first systematic assessment of data leakage issues in the use of machine learning on panel data. Our organizing framework clarifies why neglecting the cross-sectional and longitudinal structure of these data leads to hard-to-detect data leakage, inflated out-of-sample performance, and an inadvertent overestimation of the real-world usefulness and applicability of machine learning models. We then offer empirical guidelines for practitioners to ensure the correct implementation of supervised machine learning in panel data environments. An empirical application, using data from over 3,000 U.S. counties spanning 2000-2019 and focused on income prediction, illustrates the practical relevance of these points across nearly 500 models for both classification and regression tasks.
title On the (Mis)Use of Machine Learning with Panel Data
topic Econometrics
url https://arxiv.org/abs/2411.09218