Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2309.00736 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916350034706432 |
|---|---|
| author | Krupkin, Ian Hardin, Johanna |
| author_facet | Krupkin, Ian Hardin, Johanna |
| contents | In this paper, error estimates of classification Random Forests are quantitatively assessed. Based on the initial theoretical framework built by Bates et al. (2023), the true error rate and expected error rate are theoretically and empirically investigated in the context of a variety of error estimation methods common to Random Forests. We show that in the classification case, Random Forests' estimates of prediction error is closer on average to the true error rate instead of the average prediction error. This is opposite the findings of Bates et al. (2023) which are given for logistic regression. We further show that our result holds across different error estimation strategies such as cross-validation, bagging, and data splitting. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2309_00736 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Prediction Error Estimation in Random Forests Krupkin, Ian Hardin, Johanna Machine Learning In this paper, error estimates of classification Random Forests are quantitatively assessed. Based on the initial theoretical framework built by Bates et al. (2023), the true error rate and expected error rate are theoretically and empirically investigated in the context of a variety of error estimation methods common to Random Forests. We show that in the classification case, Random Forests' estimates of prediction error is closer on average to the true error rate instead of the average prediction error. This is opposite the findings of Bates et al. (2023) which are given for logistic regression. We further show that our result holds across different error estimation strategies such as cross-validation, bagging, and data splitting. |
| title | Prediction Error Estimation in Random Forests |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2309.00736 |