Saved in:
Bibliographic Details
Main Authors: Chwilczyński, Sebastian, Trębacz, Kacper, Cyganik, Karol, Małecki, Mateusz, Brzezinski, Dariusz
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2408.16285
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915173878464512
author Chwilczyński, Sebastian
Trębacz, Kacper
Cyganik, Karol
Małecki, Mateusz
Brzezinski, Dariusz
author_facet Chwilczyński, Sebastian
Trębacz, Kacper
Cyganik, Karol
Małecki, Mateusz
Brzezinski, Dariusz
contents Current interest in deep learning captures the attention of many programmers and researchers. Unfortunately, the lack of a unified schema for developing deep learning models results in methodological inconsistencies, unclear documentation, and problems with reproducibility. Some guidelines have been proposed, yet currently, they lack practical implementations. Furthermore, neural network training often takes on the form of trial and error, lacking a structured and thoughtful process. To alleviate these issues, in this paper, we introduce Art, a Python library designed to help automatically impose rules and standards while developing deep learning pipelines. Art divides model development into a series of smaller steps of increasing complexity, each concluded with a validation check improving the interpretability and robustness of the process. The current version of Art comes equipped with nine predefined steps inspired by Andrej Karpathy's Recipe for Training Neural Networks, a visualization dashboard, and integration with loggers such as Neptune. The code related to this paper is available at: https://github.com/SebChw/Actually-Robust-Training.
format Preprint
id arxiv_https___arxiv_org_abs_2408_16285
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle ART: Actually Robust Training
Chwilczyński, Sebastian
Trębacz, Kacper
Cyganik, Karol
Małecki, Mateusz
Brzezinski, Dariusz
Machine Learning
Neural and Evolutionary Computing
Current interest in deep learning captures the attention of many programmers and researchers. Unfortunately, the lack of a unified schema for developing deep learning models results in methodological inconsistencies, unclear documentation, and problems with reproducibility. Some guidelines have been proposed, yet currently, they lack practical implementations. Furthermore, neural network training often takes on the form of trial and error, lacking a structured and thoughtful process. To alleviate these issues, in this paper, we introduce Art, a Python library designed to help automatically impose rules and standards while developing deep learning pipelines. Art divides model development into a series of smaller steps of increasing complexity, each concluded with a validation check improving the interpretability and robustness of the process. The current version of Art comes equipped with nine predefined steps inspired by Andrej Karpathy's Recipe for Training Neural Networks, a visualization dashboard, and integration with loggers such as Neptune. The code related to this paper is available at: https://github.com/SebChw/Actually-Robust-Training.
title ART: Actually Robust Training
topic Machine Learning
Neural and Evolutionary Computing
url https://arxiv.org/abs/2408.16285