Scalability and Maintainability Challenges and Solutions in Machine Learning: Systematic Literature Review

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shivashankar, Karthik, Hajj, Ghadi S. Al, Martini, Antonio
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909580116623360
author Shivashankar, Karthik
Hajj, Ghadi S. Al
Martini, Antonio
author_facet Shivashankar, Karthik
Hajj, Ghadi S. Al
Martini, Antonio
contents This systematic literature review examines the critical challenges and solutions related to scalability and maintainability in Machine Learning (ML) systems. As ML applications become increasingly complex and widespread across industries, the need to balance system scalability with long-term maintainability has emerged as a significant concern. This review synthesizes current research and practices addressing these dual challenges across the entire ML life-cycle, from data engineering to model deployment in production. We analyzed 124 papers to identify and categorize 41 maintainability challenges and 13 scalability challenges, along with their corresponding solutions. Our findings reveal intricate inter dependencies between scalability and maintainability, where improvements in one often impact the other. The review is structured around six primary research questions, examining maintainability and scalability challenges in data engineering, model engineering, and ML system development. We explore how these challenges manifest differently across various stages of the ML life-cycle. This comprehensive overview offers valuable insights for both researchers and practitioners in the field of ML systems. It aims to guide future research directions, inform best practices, and contribute to the development of more robust, efficient, and sustainable ML applications across various domains.
format Preprint
id arxiv_https___arxiv_org_abs_2504_11079
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Scalability and Maintainability Challenges and Solutions in Machine Learning: Systematic Literature Review
Shivashankar, Karthik
Hajj, Ghadi S. Al
Martini, Antonio
Software Engineering
Machine Learning
This systematic literature review examines the critical challenges and solutions related to scalability and maintainability in Machine Learning (ML) systems. As ML applications become increasingly complex and widespread across industries, the need to balance system scalability with long-term maintainability has emerged as a significant concern. This review synthesizes current research and practices addressing these dual challenges across the entire ML life-cycle, from data engineering to model deployment in production. We analyzed 124 papers to identify and categorize 41 maintainability challenges and 13 scalability challenges, along with their corresponding solutions. Our findings reveal intricate inter dependencies between scalability and maintainability, where improvements in one often impact the other. The review is structured around six primary research questions, examining maintainability and scalability challenges in data engineering, model engineering, and ML system development. We explore how these challenges manifest differently across various stages of the ML life-cycle. This comprehensive overview offers valuable insights for both researchers and practitioners in the field of ML systems. It aims to guide future research directions, inform best practices, and contribute to the development of more robust, efficient, and sustainable ML applications across various domains.
title Scalability and Maintainability Challenges and Solutions in Machine Learning: Systematic Literature Review
topic Software Engineering
Machine Learning
url https://arxiv.org/abs/2504.11079