Even naive trees are consistent
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910748331999232 |
|---|---|
| author | Föge, Nico Pauly, Markus Schmid, Lena Ditzhaus, Marc |
| author_facet | Föge, Nico Pauly, Markus Schmid, Lena Ditzhaus, Marc |
| contents | The last decade has shed some light on theoretical properties such as their consistency for regression tasks. In the current paper, we propose a new class of very simple learners based on so-called naive trees. These naive trees partition the feature space completely at random and independent of the data. Although counter-intuitive, we prove these naive trees and ensembles are consistent under fairly general assumptions. However, naive trees appear to be too simple for actual application. We therefore analyze their finite sample properties in a simulation and small benchmark study. We find a slow convergence speed and a rather poor predictive performance. Based on these results, we finally discuss to what extent consistency proofs help to justify the application of complex learning algorithms. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_06850 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Even naive trees are consistent Föge, Nico Pauly, Markus Schmid, Lena Ditzhaus, Marc Statistics Theory Primary 62G05, secondary 62G20 The last decade has shed some light on theoretical properties such as their consistency for regression tasks. In the current paper, we propose a new class of very simple learners based on so-called naive trees. These naive trees partition the feature space completely at random and independent of the data. Although counter-intuitive, we prove these naive trees and ensembles are consistent under fairly general assumptions. However, naive trees appear to be too simple for actual application. We therefore analyze their finite sample properties in a simulation and small benchmark study. We find a slow convergence speed and a rather poor predictive performance. Based on these results, we finally discuss to what extent consistency proofs help to justify the application of complex learning algorithms. |
| title | Even naive trees are consistent |
| topic | Statistics Theory Primary 62G05, secondary 62G20 |
| url | https://arxiv.org/abs/2404.06850 |