Evaluating Time-Dependent Methods and Seasonal Effects in Code Technical Debt Prediction

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Robredo, Mikel, Saarimaki, Nyyti, Esposito, Matteo, Taibi, Davide, Penaloza, Rafael, Lenarduzzi, Valentina
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866911012818518016
author Robredo, Mikel
Saarimaki, Nyyti
Esposito, Matteo
Taibi, Davide
Penaloza, Rafael
Lenarduzzi, Valentina
author_facet Robredo, Mikel
Saarimaki, Nyyti
Esposito, Matteo
Taibi, Davide
Penaloza, Rafael
Lenarduzzi, Valentina
contents Background. Code Technical Debt (Code TD) prediction has gained significant attention in recent software engineering research. However, no standardized approach to Code TD prediction fully captures the factors influencing its evolution. Objective. Our study aims to assess the impact of time-dependent models and seasonal effects on Code TD prediction. It evaluates such models against widely used Machine Learning models, also considering the influence of seasonality on prediction performance. Methods. We trained 11 prediction models with 31 Java open-source projects. To assess their performance, we predicted future observations of the SQALE index. To evaluate the practical usability of our TD forecasting model and its impact on practitioners, we surveyed 23 software engineering professionals. Results. Our study confirms the benefits of time-dependent techniques, with the ARIMAX model outperforming the others. Seasonal effects improved predictive performance, though the impact remained modest. \ReviewerA{ARIMAX/SARIMAX models demonstrated to provide well-balanced long-term forecasts. The survey highlighted strong industry interest in short- to medium-term TD forecasts. Conclusions. Our findings support using techniques that capture time dependence in historical software metric data, particularly for Code TD. Effectively addressing this evidence requires adopting methods that account for temporal patterns.
format Preprint
id arxiv_https___arxiv_org_abs_2408_08095
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Evaluating Time-Dependent Methods and Seasonal Effects in Code Technical Debt Prediction
Robredo, Mikel
Saarimaki, Nyyti
Esposito, Matteo
Taibi, Davide
Penaloza, Rafael
Lenarduzzi, Valentina
Software Engineering
Background. Code Technical Debt (Code TD) prediction has gained significant attention in recent software engineering research. However, no standardized approach to Code TD prediction fully captures the factors influencing its evolution. Objective. Our study aims to assess the impact of time-dependent models and seasonal effects on Code TD prediction. It evaluates such models against widely used Machine Learning models, also considering the influence of seasonality on prediction performance. Methods. We trained 11 prediction models with 31 Java open-source projects. To assess their performance, we predicted future observations of the SQALE index. To evaluate the practical usability of our TD forecasting model and its impact on practitioners, we surveyed 23 software engineering professionals. Results. Our study confirms the benefits of time-dependent techniques, with the ARIMAX model outperforming the others. Seasonal effects improved predictive performance, though the impact remained modest. \ReviewerA{ARIMAX/SARIMAX models demonstrated to provide well-balanced long-term forecasts. The survey highlighted strong industry interest in short- to medium-term TD forecasts. Conclusions. Our findings support using techniques that capture time dependence in historical software metric data, particularly for Code TD. Effectively addressing this evidence requires adopting methods that account for temporal patterns.
title Evaluating Time-Dependent Methods and Seasonal Effects in Code Technical Debt Prediction
topic Software Engineering
url https://arxiv.org/abs/2408.08095