Studying the Impact of TensorFlow and PyTorch Bindings on Machine Learning Software Quality

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Li, Hao, Rajbahadur, Gopi Krishnan, Bezemer, Cor-Paul
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909253316378624
author Li, Hao
Rajbahadur, Gopi Krishnan
Bezemer, Cor-Paul
author_facet Li, Hao
Rajbahadur, Gopi Krishnan
Bezemer, Cor-Paul
contents Bindings for machine learning frameworks (such as TensorFlow and PyTorch) allow developers to integrate a framework's functionality using a programming language different from the framework's default language (usually Python). In this paper, we study the impact of using TensorFlow and PyTorch bindings in C#, Rust, Python and JavaScript on the software quality in terms of correctness (training and test accuracy) and time cost (training and inference time) when training and performing inference on five widely used deep learning models. Our experiments show that a model can be trained in one binding and used for inference in another binding for the same framework without losing accuracy. Our study is the first to show that using a non-default binding can help improve machine learning software quality from the time cost perspective compared to the default Python binding while still achieving the same level of correctness.
format Preprint
id arxiv_https___arxiv_org_abs_2407_05466
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Studying the Impact of TensorFlow and PyTorch Bindings on Machine Learning Software Quality
Li, Hao
Rajbahadur, Gopi Krishnan
Bezemer, Cor-Paul
Software Engineering
Artificial Intelligence
Bindings for machine learning frameworks (such as TensorFlow and PyTorch) allow developers to integrate a framework's functionality using a programming language different from the framework's default language (usually Python). In this paper, we study the impact of using TensorFlow and PyTorch bindings in C#, Rust, Python and JavaScript on the software quality in terms of correctness (training and test accuracy) and time cost (training and inference time) when training and performing inference on five widely used deep learning models. Our experiments show that a model can be trained in one binding and used for inference in another binding for the same framework without losing accuracy. Our study is the first to show that using a non-default binding can help improve machine learning software quality from the time cost perspective compared to the default Python binding while still achieving the same level of correctness.
title Studying the Impact of TensorFlow and PyTorch Bindings on Machine Learning Software Quality
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2407.05466