The Duck's Brain: Training and Inference of Neural Networks in Modern Database Engines

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schüle, Maximilian E., Neumann, Thomas, Kemper, Alfons
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910283396546560
author Schüle, Maximilian E.
Neumann, Thomas
Kemper, Alfons
author_facet Schüle, Maximilian E.
Neumann, Thomas
Kemper, Alfons
contents Although database systems perform well in data access and manipulation, their relational model hinders data scientists from formulating machine learning algorithms in SQL. Nevertheless, we argue that modern database systems perform well for machine learning algorithms expressed in relational algebra. To overcome the barrier of the relational model, this paper shows how to transform data into a relational representation for training neural networks in SQL: We first describe building blocks for data transformation, model training and inference in SQL-92 and their counterparts using an extended array data type. Then, we compare the implementation for model training and inference using array data types to the one using a relational representation in SQL-92 only. The evaluation in terms of runtime and memory consumption proves the suitability of modern database systems for matrix algebra, although specialised array data types perform better than matrices in relational representation.
format Preprint
id arxiv_https___arxiv_org_abs_2312_17355
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle The Duck's Brain: Training and Inference of Neural Networks in Modern Database Engines
Schüle, Maximilian E.
Neumann, Thomas
Kemper, Alfons
Databases
Machine Learning
H.2.4
Although database systems perform well in data access and manipulation, their relational model hinders data scientists from formulating machine learning algorithms in SQL. Nevertheless, we argue that modern database systems perform well for machine learning algorithms expressed in relational algebra. To overcome the barrier of the relational model, this paper shows how to transform data into a relational representation for training neural networks in SQL: We first describe building blocks for data transformation, model training and inference in SQL-92 and their counterparts using an extended array data type. Then, we compare the implementation for model training and inference using array data types to the one using a relational representation in SQL-92 only. The evaluation in terms of runtime and memory consumption proves the suitability of modern database systems for matrix algebra, although specialised array data types perform better than matrices in relational representation.
title The Duck's Brain: Training and Inference of Neural Networks in Modern Database Engines
topic Databases
Machine Learning
H.2.4
url https://arxiv.org/abs/2312.17355