Grafting: Making Random Forests Consistent

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteur principal: Waltz, Nicholas
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866916155366572032
author Waltz, Nicholas
author_facet Waltz, Nicholas
contents Despite their performance and widespread use, little is known about the theory of Random Forests. A major unanswered question is whether, or when, the Random Forest algorithm is consistent. The literature explores various variants of the classic Random Forest algorithm to address this question and known short-comings of the method. This paper is a contribution to this literature. Specifically, the suitability of grafting consistent estimators onto a shallow CART is explored. It is shown that this approach has a consistency guarantee and performs well in empirical settings.
format Preprint
id arxiv_https___arxiv_org_abs_2403_06015
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Grafting: Making Random Forests Consistent
Waltz, Nicholas
Machine Learning
Despite their performance and widespread use, little is known about the theory of Random Forests. A major unanswered question is whether, or when, the Random Forest algorithm is consistent. The literature explores various variants of the classic Random Forest algorithm to address this question and known short-comings of the method. This paper is a contribution to this literature. Specifically, the suitability of grafting consistent estimators onto a shallow CART is explored. It is shown that this approach has a consistency guarantee and performs well in empirical settings.
title Grafting: Making Random Forests Consistent
topic Machine Learning
url https://arxiv.org/abs/2403.06015