Finetuning LLMs for Automatic Form Interaction on Web-Browser in Selenium Testing Framework
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917095384547328 |
|---|---|
| author | Le, Nguyen-Khang Nguyen, Hiep Nguyen, Ngoc-Minh Luu, Son T. Vo, Trung Bui, Quan Minh Nomura, Shoshin Nguyen, Le-Minh |
| author_facet | Le, Nguyen-Khang Nguyen, Hiep Nguyen, Ngoc-Minh Luu, Son T. Vo, Trung Bui, Quan Minh Nomura, Shoshin Nguyen, Le-Minh |
| contents | Automated web application testing is a critical component of modern software development, with frameworks like Selenium widely adopted for validating functionality through browser automation. Among the essential aspects of such testing is the ability to interact with and validate web forms, a task that requires syntactically correct, executable scripts with high coverage of input fields. Despite its importance, this task remains underexplored in the context of large language models (LLMs), and no public benchmark or dataset exists to evaluate LLMs on form interaction generation systematically. This paper introduces a novel method for training LLMs to generate high-quality test cases in Selenium, specifically targeting form interaction testing. We curate both synthetic and human-annotated datasets for training and evaluation, covering diverse real-world forms and testing scenarios. We define clear metrics for syntax correctness, script executability, and input field coverage. Our empirical study demonstrates that our approach significantly outperforms strong baselines, including GPT-4o and other popular LLMs, across all evaluation metrics. Our work lays the groundwork for future research on LLM-based web testing and provides resources to support ongoing progress in this area. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_15168 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Finetuning LLMs for Automatic Form Interaction on Web-Browser in Selenium Testing Framework Le, Nguyen-Khang Nguyen, Hiep Nguyen, Ngoc-Minh Luu, Son T. Vo, Trung Bui, Quan Minh Nomura, Shoshin Nguyen, Le-Minh Software Engineering Artificial Intelligence I.2.7 Automated web application testing is a critical component of modern software development, with frameworks like Selenium widely adopted for validating functionality through browser automation. Among the essential aspects of such testing is the ability to interact with and validate web forms, a task that requires syntactically correct, executable scripts with high coverage of input fields. Despite its importance, this task remains underexplored in the context of large language models (LLMs), and no public benchmark or dataset exists to evaluate LLMs on form interaction generation systematically. This paper introduces a novel method for training LLMs to generate high-quality test cases in Selenium, specifically targeting form interaction testing. We curate both synthetic and human-annotated datasets for training and evaluation, covering diverse real-world forms and testing scenarios. We define clear metrics for syntax correctness, script executability, and input field coverage. Our empirical study demonstrates that our approach significantly outperforms strong baselines, including GPT-4o and other popular LLMs, across all evaluation metrics. Our work lays the groundwork for future research on LLM-based web testing and provides resources to support ongoing progress in this area. |
| title | Finetuning LLMs for Automatic Form Interaction on Web-Browser in Selenium Testing Framework |
| topic | Software Engineering Artificial Intelligence I.2.7 |
| url | https://arxiv.org/abs/2511.15168 |