A Systematic Evaluation Protocol of Graph-Derived Signals for Tabular Machine Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Heidrich, Mario, Heidemann, Jeffrey, Buchkremer, Rüdiger, de Bobadilla, Gonzalo Wandosell Fernández
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911515686207488
author Heidrich, Mario
Heidemann, Jeffrey
Buchkremer, Rüdiger
de Bobadilla, Gonzalo Wandosell Fernández
author_facet Heidrich, Mario
Heidemann, Jeffrey
Buchkremer, Rüdiger
de Bobadilla, Gonzalo Wandosell Fernández
contents While graph-derived signals are widely used in tabular learning, existing studies typically rely on limited experimental setups and average performance comparisons, leaving the statistical reliability and robustness of observed gains largely unexplored. Consequently, it remains unclear which signals provide consistent and robust improvements. This paper presents a taxonomy-driven empirical analysis of graph-derived signals for tabular machine learning. We propose a unified and reproducible evaluation protocol to systematically assess which categories of graph-derived signals yield statistically significant and robust performance improvements. The protocol provides an extensible setup for the controlled integration of diverse graph-derived signals into tabular learning pipelines. To ensure a fair and rigorous comparison, it incorporates automated hyperparameter optimization, multi-seed statistical evaluation, formal significance testing, and robustness analysis under graph perturbations. We demonstrate the protocol through an extensive case study on a large-scale, imbalanced cryptocurrency fraud detection dataset. The analysis identifies signal categories providing consistently reliable performance gains and offers interpretable insights into which graph-derived signals indicate fraud-discriminative structural patterns. Furthermore, robustness analyses reveal pronounced differences in how various signals handle missing or corrupted relational data. These findings demonstrate practical utility for fraud detection and illustrate how the proposed taxonomy-driven evaluation protocol can be applied in other application domains.
format Preprint
id arxiv_https___arxiv_org_abs_2603_13998
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Systematic Evaluation Protocol of Graph-Derived Signals for Tabular Machine Learning
Heidrich, Mario
Heidemann, Jeffrey
Buchkremer, Rüdiger
de Bobadilla, Gonzalo Wandosell Fernández
Artificial Intelligence
Machine Learning
68T05, 68T10, 68T20, 68R10, 05C50, 05C85, 62H30, 62J02, 68U05, 68W10
I.2.6; H.2.8; F.2.2; K.6.5
While graph-derived signals are widely used in tabular learning, existing studies typically rely on limited experimental setups and average performance comparisons, leaving the statistical reliability and robustness of observed gains largely unexplored. Consequently, it remains unclear which signals provide consistent and robust improvements. This paper presents a taxonomy-driven empirical analysis of graph-derived signals for tabular machine learning. We propose a unified and reproducible evaluation protocol to systematically assess which categories of graph-derived signals yield statistically significant and robust performance improvements. The protocol provides an extensible setup for the controlled integration of diverse graph-derived signals into tabular learning pipelines. To ensure a fair and rigorous comparison, it incorporates automated hyperparameter optimization, multi-seed statistical evaluation, formal significance testing, and robustness analysis under graph perturbations. We demonstrate the protocol through an extensive case study on a large-scale, imbalanced cryptocurrency fraud detection dataset. The analysis identifies signal categories providing consistently reliable performance gains and offers interpretable insights into which graph-derived signals indicate fraud-discriminative structural patterns. Furthermore, robustness analyses reveal pronounced differences in how various signals handle missing or corrupted relational data. These findings demonstrate practical utility for fraud detection and illustrate how the proposed taxonomy-driven evaluation protocol can be applied in other application domains.
title A Systematic Evaluation Protocol of Graph-Derived Signals for Tabular Machine Learning
topic Artificial Intelligence
Machine Learning
68T05, 68T10, 68T20, 68R10, 05C50, 05C85, 62H30, 62J02, 68U05, 68W10
I.2.6; H.2.8; F.2.2; K.6.5
url https://arxiv.org/abs/2603.13998