Towards Explainable Test Case Prioritisation with Learning-to-Rank Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909209122045952 |
|---|---|
| author | Ramírez, Aurora Berrios, Mario Romero, José Raúl Feldt, Robert |
| author_facet | Ramírez, Aurora Berrios, Mario Romero, José Raúl Feldt, Robert |
| contents | Test case prioritisation (TCP) is a critical task in regression testing to ensure quality as software evolves. Machine learning has become a common way to achieve it. In particular, learning-to-rank (LTR) algorithms provide an effective method of ordering and prioritising test cases. However, their use poses a challenge in terms of explainability, both globally at the model level and locally for particular results. Here, we present and discuss scenarios that require different explanations and how the particularities of TCP (multiple builds over time, test case and test suite variations, etc.) could influence them. We include a preliminary experiment to analyse the similarity of explanations, showing that they do not only vary depending on test case-specific predictions, but also on the relative ranks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_13786 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Explainable Test Case Prioritisation with Learning-to-Rank Models Ramírez, Aurora Berrios, Mario Romero, José Raúl Feldt, Robert Software Engineering Artificial Intelligence D.2.5; I.2.6 Test case prioritisation (TCP) is a critical task in regression testing to ensure quality as software evolves. Machine learning has become a common way to achieve it. In particular, learning-to-rank (LTR) algorithms provide an effective method of ordering and prioritising test cases. However, their use poses a challenge in terms of explainability, both globally at the model level and locally for particular results. Here, we present and discuss scenarios that require different explanations and how the particularities of TCP (multiple builds over time, test case and test suite variations, etc.) could influence them. We include a preliminary experiment to analyse the similarity of explanations, showing that they do not only vary depending on test case-specific predictions, but also on the relative ranks. |
| title | Towards Explainable Test Case Prioritisation with Learning-to-Rank Models |
| topic | Software Engineering Artificial Intelligence D.2.5; I.2.6 |
| url | https://arxiv.org/abs/2405.13786 |