Prepared for the Unknown: Adapting AIOps Capacity Forecasting Models to Data Changes
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917006605811712 |
|---|---|
| author | Poenaru-Olaru, Lorena Hof, Wouter van 't Stando, Adrian Trawinski, Arkadiusz P. Kapel, Eileen Rellermeyer, Jan S. Cruz, Luis van Deursen, Arie |
| author_facet | Poenaru-Olaru, Lorena Hof, Wouter van 't Stando, Adrian Trawinski, Arkadiusz P. Kapel, Eileen Rellermeyer, Jan S. Cruz, Luis van Deursen, Arie |
| contents | Capacity management is critical for software organizations to allocate resources effectively and meet operational demands. An important step in capacity management is predicting future resource needs often relies on data-driven analytics and machine learning (ML) forecasting models, which require frequent retraining to stay relevant as data evolves. Continuously retraining the forecasting models can be expensive and difficult to scale, posing a challenge for engineering teams tasked with balancing accuracy and efficiency. Retraining only when the data changes appears to be a more computationally efficient alternative, but its impact on accuracy requires further investigation. In this work, we investigate the effects of retraining capacity forecasting models for time series based on detected changes in the data compared to periodic retraining. Our results show that drift-based retraining achieves comparable forecasting accuracy to periodic retraining in most cases, making it a cost-effective strategy. However, in cases where data is changing rapidly, periodic retraining is still preferred to maximize the forecasting accuracy. These findings offer actionable insights for software teams to enhance forecasting systems, reducing retraining overhead while maintaining robust performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_10320 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Prepared for the Unknown: Adapting AIOps Capacity Forecasting Models to Data Changes Poenaru-Olaru, Lorena Hof, Wouter van 't Stando, Adrian Trawinski, Arkadiusz P. Kapel, Eileen Rellermeyer, Jan S. Cruz, Luis van Deursen, Arie Software Engineering Artificial Intelligence Capacity management is critical for software organizations to allocate resources effectively and meet operational demands. An important step in capacity management is predicting future resource needs often relies on data-driven analytics and machine learning (ML) forecasting models, which require frequent retraining to stay relevant as data evolves. Continuously retraining the forecasting models can be expensive and difficult to scale, posing a challenge for engineering teams tasked with balancing accuracy and efficiency. Retraining only when the data changes appears to be a more computationally efficient alternative, but its impact on accuracy requires further investigation. In this work, we investigate the effects of retraining capacity forecasting models for time series based on detected changes in the data compared to periodic retraining. Our results show that drift-based retraining achieves comparable forecasting accuracy to periodic retraining in most cases, making it a cost-effective strategy. However, in cases where data is changing rapidly, periodic retraining is still preferred to maximize the forecasting accuracy. These findings offer actionable insights for software teams to enhance forecasting systems, reducing retraining overhead while maintaining robust performance. |
| title | Prepared for the Unknown: Adapting AIOps Capacity Forecasting Models to Data Changes |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2510.10320 |