Graph Neural Networks on Graph Databases

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lopushanskyy, Dmytro, Shi, Borun
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917840556130304
author Lopushanskyy, Dmytro
Shi, Borun
author_facet Lopushanskyy, Dmytro
Shi, Borun
contents Training graph neural networks on large datasets has long been a challenge. Traditional approaches include efficiently representing the whole graph in-memory, designing parameter efficient and sampling-based models, and graph partitioning in a distributed setup. Separately, graph databases with native graph storage and query engines have been developed, which enable time and resource efficient graph analytics workloads. We show how to directly train a GNN on a graph DB, by retrieving minimal data into memory and sampling using the query engine. Our experiments show resource advantages for single-machine and distributed training. Our approach opens up a new way of scaling GNNs as well as a new application area for graph DBs.
format Preprint
id arxiv_https___arxiv_org_abs_2411_11375
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Graph Neural Networks on Graph Databases
Lopushanskyy, Dmytro
Shi, Borun
Machine Learning
Databases
Training graph neural networks on large datasets has long been a challenge. Traditional approaches include efficiently representing the whole graph in-memory, designing parameter efficient and sampling-based models, and graph partitioning in a distributed setup. Separately, graph databases with native graph storage and query engines have been developed, which enable time and resource efficient graph analytics workloads. We show how to directly train a GNN on a graph DB, by retrieving minimal data into memory and sampling using the query engine. Our experiments show resource advantages for single-machine and distributed training. Our approach opens up a new way of scaling GNNs as well as a new application area for graph DBs.
title Graph Neural Networks on Graph Databases
topic Machine Learning
Databases
url https://arxiv.org/abs/2411.11375