Naming the Pain in Machine Learning-Enabled Systems Engineering
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914828074876928 |
|---|---|
| author | Kalinowski, Marcos Mendez, Daniel Giray, Görkem Alves, Antonio Pedro Santos Azevedo, Kelly Escovedo, Tatiana Villamizar, Hugo Lopes, Helio Baldassarre, Teresa Wagner, Stefan Biffl, Stefan Musil, Jürgen Felderer, Michael Lavesson, Niklas Gorschek, Tony |
| author_facet | Kalinowski, Marcos Mendez, Daniel Giray, Görkem Alves, Antonio Pedro Santos Azevedo, Kelly Escovedo, Tatiana Villamizar, Hugo Lopes, Helio Baldassarre, Teresa Wagner, Stefan Biffl, Stefan Musil, Jürgen Felderer, Michael Lavesson, Niklas Gorschek, Tony |
| contents | Context: Machine learning (ML)-enabled systems are being increasingly adopted by companies aiming to enhance their products and operational processes. Objective: This paper aims to deliver a comprehensive overview of the current status quo of engineering ML-enabled systems and lay the foundation to steer practically relevant and problem-driven academic research. Method: We conducted an international survey to collect insights from practitioners on the current practices and problems in engineering ML-enabled systems. We received 188 complete responses from 25 countries. We conducted quantitative statistical analyses on contemporary practices using bootstrapping with confidence intervals and qualitative analyses on the reported problems using open and axial coding procedures. Results: Our survey results reinforce and extend existing empirical evidence on engineering ML-enabled systems, providing additional insights into typical ML-enabled systems project contexts, the perceived relevance and complexity of ML life cycle phases, and current practices related to problem understanding, model deployment, and model monitoring. Furthermore, the qualitative analysis provides a detailed map of the problems practitioners face within each ML life cycle phase and the problems causing overall project failure. Conclusions: The results contribute to a better understanding of the status quo and problems in practical environments. We advocate for the further adaptation and dissemination of software engineering practices to enhance the engineering of ML-enabled systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_04359 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Naming the Pain in Machine Learning-Enabled Systems Engineering Kalinowski, Marcos Mendez, Daniel Giray, Görkem Alves, Antonio Pedro Santos Azevedo, Kelly Escovedo, Tatiana Villamizar, Hugo Lopes, Helio Baldassarre, Teresa Wagner, Stefan Biffl, Stefan Musil, Jürgen Felderer, Michael Lavesson, Niklas Gorschek, Tony Software Engineering Artificial Intelligence Context: Machine learning (ML)-enabled systems are being increasingly adopted by companies aiming to enhance their products and operational processes. Objective: This paper aims to deliver a comprehensive overview of the current status quo of engineering ML-enabled systems and lay the foundation to steer practically relevant and problem-driven academic research. Method: We conducted an international survey to collect insights from practitioners on the current practices and problems in engineering ML-enabled systems. We received 188 complete responses from 25 countries. We conducted quantitative statistical analyses on contemporary practices using bootstrapping with confidence intervals and qualitative analyses on the reported problems using open and axial coding procedures. Results: Our survey results reinforce and extend existing empirical evidence on engineering ML-enabled systems, providing additional insights into typical ML-enabled systems project contexts, the perceived relevance and complexity of ML life cycle phases, and current practices related to problem understanding, model deployment, and model monitoring. Furthermore, the qualitative analysis provides a detailed map of the problems practitioners face within each ML life cycle phase and the problems causing overall project failure. Conclusions: The results contribute to a better understanding of the status quo and problems in practical environments. We advocate for the further adaptation and dissemination of software engineering practices to enhance the engineering of ML-enabled systems. |
| title | Naming the Pain in Machine Learning-Enabled Systems Engineering |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2406.04359 |