ReproBreak: A Dataset of Reproducible Web Locator Breaks

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: de Moura, Thiago Santos, Adamietz, Leon, Mehboob, Samra, Noller, Yannic
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916005279694848
author de Moura, Thiago Santos
Adamietz, Leon
Mehboob, Samra
Noller, Yannic
author_facet de Moura, Thiago Santos
Adamietz, Leon
Mehboob, Samra
Noller, Yannic
contents Automated GUI testing frameworks such as Cypress and Playwright rely on locators to find and interact with web elements. A locator break occurs when a structural change in the application under test causes a locator to no longer find its target element, resulting in test breakages even when the underlying functionality remains unchanged. Despite its impact on test maintenance, no dataset exists to evaluate locator fragility in Cypress and Playwright at scale. In this paper, we present ReproBreak, a dataset of reproducible locator breaks in web application GUI tests. We analyzed 359 open-source repositories to identify commits that contain locator changes. To confirm whether these changes are indeed locator breaks, we reproduced them in the top 4 projects with the largest number of locator changes and found 449 locator breaks, which are provided in the dataset along with scripts for automated reproduction. We believe ReproBreak serves as a valuable artifact to support research on locator fragility, repair techniques, and test robustness. The video is available at: https://youtu.be/mZByS_TnCvE. The dataset is at https://github.com/rub-sq/ReproBreak.
format Preprint
id arxiv_https___arxiv_org_abs_2605_12158
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle ReproBreak: A Dataset of Reproducible Web Locator Breaks
de Moura, Thiago Santos
Adamietz, Leon
Mehboob, Samra
Noller, Yannic
Software Engineering
Automated GUI testing frameworks such as Cypress and Playwright rely on locators to find and interact with web elements. A locator break occurs when a structural change in the application under test causes a locator to no longer find its target element, resulting in test breakages even when the underlying functionality remains unchanged. Despite its impact on test maintenance, no dataset exists to evaluate locator fragility in Cypress and Playwright at scale. In this paper, we present ReproBreak, a dataset of reproducible locator breaks in web application GUI tests. We analyzed 359 open-source repositories to identify commits that contain locator changes. To confirm whether these changes are indeed locator breaks, we reproduced them in the top 4 projects with the largest number of locator changes and found 449 locator breaks, which are provided in the dataset along with scripts for automated reproduction. We believe ReproBreak serves as a valuable artifact to support research on locator fragility, repair techniques, and test robustness. The video is available at: https://youtu.be/mZByS_TnCvE. The dataset is at https://github.com/rub-sq/ReproBreak.
title ReproBreak: A Dataset of Reproducible Web Locator Breaks
topic Software Engineering
url https://arxiv.org/abs/2605.12158