Graph Neural Networks Powered by Encoder Embedding for Improved Node Learning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Chen, Shiyu, Shen, Cencheng, Park, Youngser, Priebe, Carey E.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911460503846912
author Chen, Shiyu
Shen, Cencheng
Park, Youngser
Priebe, Carey E.
author_facet Chen, Shiyu
Shen, Cencheng
Park, Youngser
Priebe, Carey E.
contents Graph neural networks (GNNs) have emerged as a powerful framework for a wide range of node-level graph learning tasks. However, their performance typically depends on random or minimally informed initial feature representations, where poor initialization can lead to slower convergence and increased training instability. In this paper, we address this limitation by leveraging a statistically grounded one-hot graph encoder embedding (GEE) as a high-quality, structure-aware initialization for node features. Integrating GEE into standard GNNs yields the GEE-powered GNN (GG) framework. Across extensive simulations and real-world benchmarks, GG provides consistent and substantial performance gains in both unsupervised and supervised settings. For node classification, we further introduce GG-C, which concatenates the outputs of GG and GEE and outperforms competing methods, achieving roughly 10-50% accuracy improvements across most datasets. These results demonstrate the importance of principled, structure-aware initialization for improving the efficiency, stability, and overall performance of graph neural network architecture, enabling models to better exploit graph topology from the outset.
format Preprint
id arxiv_https___arxiv_org_abs_2507_11732
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Graph Neural Networks Powered by Encoder Embedding for Improved Node Learning
Chen, Shiyu
Shen, Cencheng
Park, Youngser
Priebe, Carey E.
Machine Learning
Graph neural networks (GNNs) have emerged as a powerful framework for a wide range of node-level graph learning tasks. However, their performance typically depends on random or minimally informed initial feature representations, where poor initialization can lead to slower convergence and increased training instability. In this paper, we address this limitation by leveraging a statistically grounded one-hot graph encoder embedding (GEE) as a high-quality, structure-aware initialization for node features. Integrating GEE into standard GNNs yields the GEE-powered GNN (GG) framework. Across extensive simulations and real-world benchmarks, GG provides consistent and substantial performance gains in both unsupervised and supervised settings. For node classification, we further introduce GG-C, which concatenates the outputs of GG and GEE and outperforms competing methods, achieving roughly 10-50% accuracy improvements across most datasets. These results demonstrate the importance of principled, structure-aware initialization for improving the efficiency, stability, and overall performance of graph neural network architecture, enabling models to better exploit graph topology from the outset.
title Graph Neural Networks Powered by Encoder Embedding for Improved Node Learning
topic Machine Learning
url https://arxiv.org/abs/2507.11732