RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916546395242496 |
|---|---|
| author | Li, Zhen Yang, Weikai Yuan, Jun Wu, Jing Chen, Changjian Ming, Yao Yang, Fan Zhang, Hui Liu, Shixia |
| author_facet | Li, Zhen Yang, Weikai Yuan, Jun Wu, Jing Chen, Changjian Ming, Yao Yang, Fan Zhang, Hui Liu, Shixia |
| contents | The high performance of tree ensemble classifiers benefits from a large set of rules, which, in turn, makes the models hard to understand. To improve interpretability, existing methods extract a subset of rules for approximation using model reduction techniques. However, by focusing on the reduced rule set, these methods often lose fidelity and ignore anomalous rules that, despite their infrequency, play crucial roles in real-world applications. This paper introduces a scalable visual analysis method to explain tree ensemble classifiers that contain tens of thousands of rules. The key idea is to address the issue of losing fidelity by adaptively organizing the rules as a hierarchy rather than reducing them. To ensure the inclusion of anomalous rules, we develop an anomaly-biased model reduction method to prioritize these rules at each hierarchical level. Synergized with this hierarchical organization of rules, we develop a matrix-based hierarchical visualization to support exploration at different levels of detail. Our quantitative experiments and case studies demonstrate how our method fosters a deeper understanding of both common and anomalous rules, thereby enhancing interpretability without sacrificing comprehensiveness. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_03164 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers Li, Zhen Yang, Weikai Yuan, Jun Wu, Jing Chen, Changjian Ming, Yao Yang, Fan Zhang, Hui Liu, Shixia Machine Learning Graphics The high performance of tree ensemble classifiers benefits from a large set of rules, which, in turn, makes the models hard to understand. To improve interpretability, existing methods extract a subset of rules for approximation using model reduction techniques. However, by focusing on the reduced rule set, these methods often lose fidelity and ignore anomalous rules that, despite their infrequency, play crucial roles in real-world applications. This paper introduces a scalable visual analysis method to explain tree ensemble classifiers that contain tens of thousands of rules. The key idea is to address the issue of losing fidelity by adaptively organizing the rules as a hierarchy rather than reducing them. To ensure the inclusion of anomalous rules, we develop an anomaly-biased model reduction method to prioritize these rules at each hierarchical level. Synergized with this hierarchical organization of rules, we develop a matrix-based hierarchical visualization to support exploration at different levels of detail. Our quantitative experiments and case studies demonstrate how our method fosters a deeper understanding of both common and anomalous rules, thereby enhancing interpretability without sacrificing comprehensiveness. |
| title | RuleExplorer: A Scalable Matrix Visualization for Understanding Tree Ensemble Classifiers |
| topic | Machine Learning Graphics |
| url | https://arxiv.org/abs/2409.03164 |