Interpretable Graph Neural Networks for Heterogeneous Tabular Data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Alkhatib, Amr, Boström, Henrik
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910565504385024
author Alkhatib, Amr
Boström, Henrik
author_facet Alkhatib, Amr
Boström, Henrik
contents Many machine learning algorithms for tabular data produce black-box models, which prevent users from understanding the rationale behind the model predictions. In their unconstrained form, graph neural networks fall into this category, and they have further limited abilities to handle heterogeneous data. To overcome these limitations, an approach is proposed, called IGNH (Interpretable Graph Neural Network for Heterogeneous tabular data), which handles both categorical and numerical features, while constraining the learning process to generate exact feature attributions together with the predictions. A large-scale empirical investigation is presented, showing that the feature attributions provided by IGNH align with Shapley values that are computed post hoc. Furthermore, the results show that IGNH outperforms two powerful machine learning algorithms for tabular data, Random Forests and TabNet, while reaching a similar level of performance as XGBoost.
format Preprint
id arxiv_https___arxiv_org_abs_2408_07661
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Interpretable Graph Neural Networks for Heterogeneous Tabular Data
Alkhatib, Amr
Boström, Henrik
Machine Learning
Many machine learning algorithms for tabular data produce black-box models, which prevent users from understanding the rationale behind the model predictions. In their unconstrained form, graph neural networks fall into this category, and they have further limited abilities to handle heterogeneous data. To overcome these limitations, an approach is proposed, called IGNH (Interpretable Graph Neural Network for Heterogeneous tabular data), which handles both categorical and numerical features, while constraining the learning process to generate exact feature attributions together with the predictions. A large-scale empirical investigation is presented, showing that the feature attributions provided by IGNH align with Shapley values that are computed post hoc. Furthermore, the results show that IGNH outperforms two powerful machine learning algorithms for tabular data, Random Forests and TabNet, while reaching a similar level of performance as XGBoost.
title Interpretable Graph Neural Networks for Heterogeneous Tabular Data
topic Machine Learning
url https://arxiv.org/abs/2408.07661