Constructing Decision Trees from Data Streams

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Pham, Huy, Ta, Hoang, Vu, Hoa T.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916693363654656
author Pham, Huy
Ta, Hoang
Vu, Hoa T.
author_facet Pham, Huy
Ta, Hoang
Vu, Hoa T.
contents In this work, we present data stream algorithms to compute optimal splits for decision tree learning. In particular, given a data stream of observations \(x_i\) and their corresponding labels \(y_i\), without the i.i.d. assumption, the objective is to identify the optimal split \(j\) that partitions the data into two sets, minimizing the mean squared error (for regression) or the misclassification rate and Gini impurity (for classification). We propose several efficient streaming algorithms that require sublinear space and use a small number of passes to solve these problems. These algorithms can also be extended to the MapReduce model. Our results, while not directly comparable, complements the seminal work of Domingos-Hulten (KDD 2000) and Hulten-Spencer-Domingos (KDD 2001).
format Preprint
id arxiv_https___arxiv_org_abs_2403_19867
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Constructing Decision Trees from Data Streams
Pham, Huy
Ta, Hoang
Vu, Hoa T.
Data Structures and Algorithms
Artificial Intelligence
Machine Learning
In this work, we present data stream algorithms to compute optimal splits for decision tree learning. In particular, given a data stream of observations \(x_i\) and their corresponding labels \(y_i\), without the i.i.d. assumption, the objective is to identify the optimal split \(j\) that partitions the data into two sets, minimizing the mean squared error (for regression) or the misclassification rate and Gini impurity (for classification). We propose several efficient streaming algorithms that require sublinear space and use a small number of passes to solve these problems. These algorithms can also be extended to the MapReduce model. Our results, while not directly comparable, complements the seminal work of Domingos-Hulten (KDD 2000) and Hulten-Spencer-Domingos (KDD 2001).
title Constructing Decision Trees from Data Streams
topic Data Structures and Algorithms
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2403.19867