Towards Architecting Sustainable MLOps: A Self-Adaptation Approach

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Bhatt, Hiya, Arun, Shrikara, Kakran, Adyansh, Vaidhyanathan, Karthik
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911828945141760
author Bhatt, Hiya
Arun, Shrikara
Kakran, Adyansh
Vaidhyanathan, Karthik
author_facet Bhatt, Hiya
Arun, Shrikara
Kakran, Adyansh
Vaidhyanathan, Karthik
contents In today's dynamic technological landscape, sustainability has emerged as a pivotal concern, especially with respect to architecting Machine Learning enabled Systems (MLS). Many ML models fail in transitioning to production, primarily hindered by uncertainties due to data variations, evolving requirements, and model instabilities. Machine Learning Operations (MLOps) offers a promising solution by enhancing adaptability and technical sustainability in MLS. However, MLOps itself faces challenges related to environmental impact, technical maintenance, and economic concerns. Over the years, self-adaptation has emerged as a potential solution to handle uncertainties. This paper introduces a novel approach employing self-adaptive principles integrated into the MLOps architecture through a MAPE-K loop to bolster MLOps sustainability. By autonomously responding to uncertainties, including data, model dynamics, and environmental variations, our approach aims to address the sustainability concerns of a given MLOps pipeline identified by an architect at design time. Further, we implement the method for a Smart City use case to display the capabilities of our approach.
format Preprint
id arxiv_https___arxiv_org_abs_2404_04572
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Towards Architecting Sustainable MLOps: A Self-Adaptation Approach
Bhatt, Hiya
Arun, Shrikara
Kakran, Adyansh
Vaidhyanathan, Karthik
Software Engineering
In today's dynamic technological landscape, sustainability has emerged as a pivotal concern, especially with respect to architecting Machine Learning enabled Systems (MLS). Many ML models fail in transitioning to production, primarily hindered by uncertainties due to data variations, evolving requirements, and model instabilities. Machine Learning Operations (MLOps) offers a promising solution by enhancing adaptability and technical sustainability in MLS. However, MLOps itself faces challenges related to environmental impact, technical maintenance, and economic concerns. Over the years, self-adaptation has emerged as a potential solution to handle uncertainties. This paper introduces a novel approach employing self-adaptive principles integrated into the MLOps architecture through a MAPE-K loop to bolster MLOps sustainability. By autonomously responding to uncertainties, including data, model dynamics, and environmental variations, our approach aims to address the sustainability concerns of a given MLOps pipeline identified by an architect at design time. Further, we implement the method for a Smart City use case to display the capabilities of our approach.
title Towards Architecting Sustainable MLOps: A Self-Adaptation Approach
topic Software Engineering
url https://arxiv.org/abs/2404.04572