Very fast Bayesian Additive Regression Trees on GPU

Fuente: arXiv
Saved in:
Bibliographic Details
Main Author: Petrillo, Giacomo
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911046154846208
author Petrillo, Giacomo
author_facet Petrillo, Giacomo
contents Bayesian Additive Regression Trees (BART) is a nonparametric Bayesian regression technique based on an ensemble of decision trees. It is part of the toolbox of many statisticians. The overall statistical quality of the regression is typically higher than other generic alternatives, and it requires less manual tuning, making it a good default choice. However, it is a niche method compared to its natural competitor XGBoost, due to the longer running time, making sample sizes above 10,000-100,000 a nuisance. I present a GPU-enabled implementation of BART, faster by up to 200x relative to a single CPU core, making BART competitive in running time with XGBoost. This implementation is available in the Python package bartz.
format Preprint
id arxiv_https___arxiv_org_abs_2410_23244
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Very fast Bayesian Additive Regression Trees on GPU
Petrillo, Giacomo
Machine Learning
Bayesian Additive Regression Trees (BART) is a nonparametric Bayesian regression technique based on an ensemble of decision trees. It is part of the toolbox of many statisticians. The overall statistical quality of the regression is typically higher than other generic alternatives, and it requires less manual tuning, making it a good default choice. However, it is a niche method compared to its natural competitor XGBoost, due to the longer running time, making sample sizes above 10,000-100,000 a nuisance. I present a GPU-enabled implementation of BART, faster by up to 200x relative to a single CPU core, making BART competitive in running time with XGBoost. This implementation is available in the Python package bartz.
title Very fast Bayesian Additive Regression Trees on GPU
topic Machine Learning
url https://arxiv.org/abs/2410.23244