A Rectification-Based Approach for Distilling Boosted Trees into Decision Trees

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Audemard, Gilles, Coste-Marquis, Sylvie, Marquis, Pierre, Sabiri, Mehdi, Szczepanski, Nicolas
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909862203490304
author Audemard, Gilles
Coste-Marquis, Sylvie
Marquis, Pierre
Sabiri, Mehdi
Szczepanski, Nicolas
author_facet Audemard, Gilles
Coste-Marquis, Sylvie
Marquis, Pierre
Sabiri, Mehdi
Szczepanski, Nicolas
contents We present a new approach for distilling boosted trees into decision trees, in the objective of generating an ML model offering an acceptable compromise in terms of predictive performance and interpretability. We explain how the correction approach called rectification can be used to implement such a distillation process. We show empirically that this approach provides interesting results, in comparison with an approach to distillation achieved by retraining the model.
format Preprint
id arxiv_https___arxiv_org_abs_2510_18615
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Rectification-Based Approach for Distilling Boosted Trees into Decision Trees
Audemard, Gilles
Coste-Marquis, Sylvie
Marquis, Pierre
Sabiri, Mehdi
Szczepanski, Nicolas
Machine Learning
Artificial Intelligence
We present a new approach for distilling boosted trees into decision trees, in the objective of generating an ML model offering an acceptable compromise in terms of predictive performance and interpretability. We explain how the correction approach called rectification can be used to implement such a distillation process. We show empirically that this approach provides interesting results, in comparison with an approach to distillation achieved by retraining the model.
title A Rectification-Based Approach for Distilling Boosted Trees into Decision Trees
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2510.18615