The Generalized Proximity Forest

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Shaw, Ben, Rustad, Adam, Maia, Sofia Pelagalli, Rhodes, Jake S., Moon, Kevin R.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914169783058432
author Shaw, Ben
Rustad, Adam
Maia, Sofia Pelagalli
Rhodes, Jake S.
Moon, Kevin R.
author_facet Shaw, Ben
Rustad, Adam
Maia, Sofia Pelagalli
Rhodes, Jake S.
Moon, Kevin R.
contents Recent work has demonstrated the utility of Random Forest (RF) proximities for various supervised machine learning tasks, including outlier detection, missing data imputation, and visualization. However, the utility of the RF proximities depends upon the success of the RF model, which itself is not the ideal model in all contexts. RF proximities have recently been extended to time series by means of the distance-based Proximity Forest (PF) model, among others, affording time series analysis with the benefits of RF proximities. In this work, we introduce the generalized PF model, thereby extending RF proximities to all contexts in which supervised distance-based machine learning can occur. Additionally, we introduce a variant of the PF model for regression tasks. We also introduce the notion of using the generalized PF model as a meta-learning framework, extending supervised imputation capability to any pre-trained classifier. We experimentally demonstrate the unique advantages of the generalized PF model compared with both the RF model and the $k$-nearest neighbors model.
format Preprint
id arxiv_https___arxiv_org_abs_2511_19487
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Generalized Proximity Forest
Shaw, Ben
Rustad, Adam
Maia, Sofia Pelagalli
Rhodes, Jake S.
Moon, Kevin R.
Machine Learning
Recent work has demonstrated the utility of Random Forest (RF) proximities for various supervised machine learning tasks, including outlier detection, missing data imputation, and visualization. However, the utility of the RF proximities depends upon the success of the RF model, which itself is not the ideal model in all contexts. RF proximities have recently been extended to time series by means of the distance-based Proximity Forest (PF) model, among others, affording time series analysis with the benefits of RF proximities. In this work, we introduce the generalized PF model, thereby extending RF proximities to all contexts in which supervised distance-based machine learning can occur. Additionally, we introduce a variant of the PF model for regression tasks. We also introduce the notion of using the generalized PF model as a meta-learning framework, extending supervised imputation capability to any pre-trained classifier. We experimentally demonstrate the unique advantages of the generalized PF model compared with both the RF model and the $k$-nearest neighbors model.
title The Generalized Proximity Forest
topic Machine Learning
url https://arxiv.org/abs/2511.19487