Generating Global and Local Explanations for Tree-Ensemble Learning Methods by Answer Set Programming

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Takemura, Akihiro, Inoue, Katsumi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915112249458688
author Takemura, Akihiro
Inoue, Katsumi
author_facet Takemura, Akihiro
Inoue, Katsumi
contents We propose a method for generating rule sets as global and local explanations for tree-ensemble learning methods using Answer Set Programming (ASP). To this end, we adopt a decompositional approach where the split structures of the base decision trees are exploited in the construction of rules, which in turn are assessed using pattern mining methods encoded in ASP to extract explanatory rules. For global explanations, candidate rules are chosen from the entire trained tree-ensemble models, whereas for local explanations, candidate rules are selected by only considering rules that are relevant to the particular predicted instance. We show how user-defined constraints and preferences can be represented declaratively in ASP to allow for transparent and flexible rule set generation, and how rules can be used as explanations to help the user better understand the models. Experimental evaluation with real-world datasets and popular tree-ensemble algorithms demonstrates that our approach is applicable to a wide range of classification tasks. Under consideration in Theory and Practice of Logic Programming (TPLP).
format Preprint
id arxiv_https___arxiv_org_abs_2410_11000
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generating Global and Local Explanations for Tree-Ensemble Learning Methods by Answer Set Programming
Takemura, Akihiro
Inoue, Katsumi
Artificial Intelligence
We propose a method for generating rule sets as global and local explanations for tree-ensemble learning methods using Answer Set Programming (ASP). To this end, we adopt a decompositional approach where the split structures of the base decision trees are exploited in the construction of rules, which in turn are assessed using pattern mining methods encoded in ASP to extract explanatory rules. For global explanations, candidate rules are chosen from the entire trained tree-ensemble models, whereas for local explanations, candidate rules are selected by only considering rules that are relevant to the particular predicted instance. We show how user-defined constraints and preferences can be represented declaratively in ASP to allow for transparent and flexible rule set generation, and how rules can be used as explanations to help the user better understand the models. Experimental evaluation with real-world datasets and popular tree-ensemble algorithms demonstrates that our approach is applicable to a wide range of classification tasks. Under consideration in Theory and Practice of Logic Programming (TPLP).
title Generating Global and Local Explanations for Tree-Ensemble Learning Methods by Answer Set Programming
topic Artificial Intelligence
url https://arxiv.org/abs/2410.11000