Towards Continuous Experiment-driven MLOps
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866915183114321920 |
|---|---|
| author | Rajenthiram, Keerthiga Abdullah, Milad Gerostathopoulos, Ilias Hnetynka, Petr Bureš, Tomáš Pons, Gerard Bilalli, Besim Queralt, Anna |
| author_facet | Rajenthiram, Keerthiga Abdullah, Milad Gerostathopoulos, Ilias Hnetynka, Petr Bureš, Tomáš Pons, Gerard Bilalli, Besim Queralt, Anna |
| contents | Despite advancements in MLOps and AutoML, ML development still remains challenging for data scientists. First, there is poor support for and limited control over optimizing and evolving ML models. Second, there is lack of efficient mechanisms for continuous evolution of ML models which would leverage the knowledge gained in previous optimizations of the same or different models. We propose an experiment-driven MLOps approach which tackles these problems. Our approach relies on the concept of an experiment, which embodies a fully controllable optimization process. It introduces full traceability and repeatability to the optimization process, allows humans to be in full control of it, and enables continuous improvement of the ML system. Importantly, it also establishes knowledge, which is carried over and built across a series of experiments and allows for improving the efficiency of experimentation over time. We demonstrate our approach through its realization and application in the ExtremeXP1 project (Horizon Europe). |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_03455 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Towards Continuous Experiment-driven MLOps Rajenthiram, Keerthiga Abdullah, Milad Gerostathopoulos, Ilias Hnetynka, Petr Bureš, Tomáš Pons, Gerard Bilalli, Besim Queralt, Anna Software Engineering Despite advancements in MLOps and AutoML, ML development still remains challenging for data scientists. First, there is poor support for and limited control over optimizing and evolving ML models. Second, there is lack of efficient mechanisms for continuous evolution of ML models which would leverage the knowledge gained in previous optimizations of the same or different models. We propose an experiment-driven MLOps approach which tackles these problems. Our approach relies on the concept of an experiment, which embodies a fully controllable optimization process. It introduces full traceability and repeatability to the optimization process, allows humans to be in full control of it, and enables continuous improvement of the ML system. Importantly, it also establishes knowledge, which is carried over and built across a series of experiments and allows for improving the efficiency of experimentation over time. We demonstrate our approach through its realization and application in the ExtremeXP1 project (Horizon Europe). |
| title | Towards Continuous Experiment-driven MLOps |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2503.03455 |