Toward the Automated Localization of Buggy Mobile App UIs from Bug Descriptions

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Saha, Antu, Song, Yang, Mahmud, Junayed, Zhou, Ying, Moran, Kevin, Chaparro, Oscar
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916350407999488
author Saha, Antu
Song, Yang
Mahmud, Junayed
Zhou, Ying
Moran, Kevin
Chaparro, Oscar
author_facet Saha, Antu
Song, Yang
Mahmud, Junayed
Zhou, Ying
Moran, Kevin
Chaparro, Oscar
contents Bug report management is a costly software maintenance process comprised of several challenging tasks. Given the UI-driven nature of mobile apps, bugs typically manifest through the UI, hence the identification of buggy UI screens and UI components (Buggy UI Localization) is important to localizing the buggy behavior and eventually fixing it. However, this task is challenging as developers must reason about bug descriptions (which are often low-quality), and the visual or code-based representations of UI screens. This paper is the first to investigate the feasibility of automating the task of Buggy UI Localization through a comprehensive study that evaluates the capabilities of one textual and two multi-modal deep learning (DL) techniques and one textual unsupervised technique. We evaluate such techniques at two levels of granularity, Buggy UI Screen and UI Component localization. Our results illustrate the individual strengths of models that make use of different representations, wherein models that incorporate visual information perform better for UI screen localization, and models that operate on textual screen information perform better for UI component localization -- highlighting the need for a localization approach that blends the benefits of both types of techniques. Furthermore, we study whether Buggy UI Localization can improve traditional buggy code localization, and find that incorporating localized buggy UIs leads to improvements of 9%-12% in Hits@10.
format Preprint
id arxiv_https___arxiv_org_abs_2408_04075
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Toward the Automated Localization of Buggy Mobile App UIs from Bug Descriptions
Saha, Antu
Song, Yang
Mahmud, Junayed
Zhou, Ying
Moran, Kevin
Chaparro, Oscar
Software Engineering
Bug report management is a costly software maintenance process comprised of several challenging tasks. Given the UI-driven nature of mobile apps, bugs typically manifest through the UI, hence the identification of buggy UI screens and UI components (Buggy UI Localization) is important to localizing the buggy behavior and eventually fixing it. However, this task is challenging as developers must reason about bug descriptions (which are often low-quality), and the visual or code-based representations of UI screens. This paper is the first to investigate the feasibility of automating the task of Buggy UI Localization through a comprehensive study that evaluates the capabilities of one textual and two multi-modal deep learning (DL) techniques and one textual unsupervised technique. We evaluate such techniques at two levels of granularity, Buggy UI Screen and UI Component localization. Our results illustrate the individual strengths of models that make use of different representations, wherein models that incorporate visual information perform better for UI screen localization, and models that operate on textual screen information perform better for UI component localization -- highlighting the need for a localization approach that blends the benefits of both types of techniques. Furthermore, we study whether Buggy UI Localization can improve traditional buggy code localization, and find that incorporating localized buggy UIs leads to improvements of 9%-12% in Hits@10.
title Toward the Automated Localization of Buggy Mobile App UIs from Bug Descriptions
topic Software Engineering
url https://arxiv.org/abs/2408.04075