Detection of Performance Changes in MooBench Results Using Nyrkiö on GitHub Actions
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918159428091904 |
|---|---|
| author | Yang, Shinhyung Reichelt, David Georg Ingo, Henrik Hasselbring, Wilhelm |
| author_facet | Yang, Shinhyung Reichelt, David Georg Ingo, Henrik Hasselbring, Wilhelm |
| contents | In GitHub with its 518 million hosted projects, performance changes within these projects are highly relevant to the project's users. Although performance measurement is supported by GitHub CI/CD, performance change detection is a challenging topic.
In this paper, we demonstrate how we incorporated Nyrkiö to MooBench. Prior to this work, Moobench continuously ran on GitHub virtual machines, measuring overhead of tracing agents, but without change detection. By adding the upload of the measurements to the Nyrkiö change detection service, we made it possible to detect performance changes. We identified one major performance regression and examined the performance change in depth. We report that (1) it is reproducible with GitHub actions, and (2) the performance regression is caused by a Linux Kernel version change. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_11310 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Detection of Performance Changes in MooBench Results Using Nyrkiö on GitHub Actions Yang, Shinhyung Reichelt, David Georg Ingo, Henrik Hasselbring, Wilhelm Software Engineering Operating Systems Performance D.2.8; D.4.8; C.4 In GitHub with its 518 million hosted projects, performance changes within these projects are highly relevant to the project's users. Although performance measurement is supported by GitHub CI/CD, performance change detection is a challenging topic. In this paper, we demonstrate how we incorporated Nyrkiö to MooBench. Prior to this work, Moobench continuously ran on GitHub virtual machines, measuring overhead of tracing agents, but without change detection. By adding the upload of the measurements to the Nyrkiö change detection service, we made it possible to detect performance changes. We identified one major performance regression and examined the performance change in depth. We report that (1) it is reproducible with GitHub actions, and (2) the performance regression is caused by a Linux Kernel version change. |
| title | Detection of Performance Changes in MooBench Results Using Nyrkiö on GitHub Actions |
| topic | Software Engineering Operating Systems Performance D.2.8; D.4.8; C.4 |
| url | https://arxiv.org/abs/2510.11310 |