Saved in:
Bibliographic Details
Main Authors: Shahbandeh, Mobina, Alian, Parsa, Nashid, Noor, Mesbah, Ali
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.10741
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913503533596672
author Shahbandeh, Mobina
Alian, Parsa
Nashid, Noor
Mesbah, Ali
author_facet Shahbandeh, Mobina
Alian, Parsa
Nashid, Noor
Mesbah, Ali
contents End-to-end web testing is challenging due to the need to explore diverse web application functionalities. Current state-of-the-art methods, such as WebCanvas, are not designed for broad functionality exploration; they rely on specific, detailed task descriptions, limiting their adaptability in dynamic web environments. We introduce NaviQAte, which frames web application exploration as a question-and-answer task, generating action sequences for functionalities without requiring detailed parameters. Our three-phase approach utilizes advanced large language models like GPT-4o for complex decision-making and cost-effective models, such as GPT-4o mini, for simpler tasks. NaviQAte focuses on functionality-guided web application navigation, integrating multi-modal inputs such as text and images to enhance contextual understanding. Evaluations on the Mind2Web-Live and Mind2Web-Live-Abstracted datasets show that NaviQAte achieves a 44.23% success rate in user task navigation and a 38.46% success rate in functionality navigation, representing a 15% and 33% improvement over WebCanvas. These results underscore the effectiveness of our approach in advancing automated web application testing.
format Preprint
id arxiv_https___arxiv_org_abs_2409_10741
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle NaviQAte: Functionality-Guided Web Application Navigation
Shahbandeh, Mobina
Alian, Parsa
Nashid, Noor
Mesbah, Ali
Software Engineering
Computation and Language
End-to-end web testing is challenging due to the need to explore diverse web application functionalities. Current state-of-the-art methods, such as WebCanvas, are not designed for broad functionality exploration; they rely on specific, detailed task descriptions, limiting their adaptability in dynamic web environments. We introduce NaviQAte, which frames web application exploration as a question-and-answer task, generating action sequences for functionalities without requiring detailed parameters. Our three-phase approach utilizes advanced large language models like GPT-4o for complex decision-making and cost-effective models, such as GPT-4o mini, for simpler tasks. NaviQAte focuses on functionality-guided web application navigation, integrating multi-modal inputs such as text and images to enhance contextual understanding. Evaluations on the Mind2Web-Live and Mind2Web-Live-Abstracted datasets show that NaviQAte achieves a 44.23% success rate in user task navigation and a 38.46% success rate in functionality navigation, representing a 15% and 33% improvement over WebCanvas. These results underscore the effectiveness of our approach in advancing automated web application testing.
title NaviQAte: Functionality-Guided Web Application Navigation
topic Software Engineering
Computation and Language
url https://arxiv.org/abs/2409.10741