Harnessing the Power of Large Language Models for Software Testing Education: A Focus on ISTQB Syllabus
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914115062071296 |
|---|---|
| author | Ngo, Tuan-Phong Duong, Bao-Ngoc Hoang, Tuan-Anh Dwight, Joshua Khwakhali, Ushik Shrestha |
| author_facet | Ngo, Tuan-Phong Duong, Bao-Ngoc Hoang, Tuan-Anh Dwight, Joshua Khwakhali, Ushik Shrestha |
| contents | Software testing is a critical component in the software engineering field and is important for software engineering education. Thus, it is vital for academia to continuously improve and update educational methods to reflect the current state of the field. The International Software Testing Qualifications Board (ISTQB) certification framework is globally recognized and widely adopted in industry and academia. However, ISTQB-based learning has been rarely applied with recent generative artificial intelligence advances. Despite the growing capabilities of large language models (LLMs), ISTQB-based learning and instruction with LLMs have not been thoroughly explored. This paper explores and evaluates how LLMs can complement the ISTQB framework for higher education. The findings present four key contributions: (i) the creation of a comprehensive ISTQB-aligned dataset spanning over a decade, consisting of 28 sample exams and 1,145 questions; (ii) the development of a domain-optimized prompt that enhances LLM precision and explanation quality on ISTQB tasks; (iii) a systematic evaluation of state-of-the-art LLMs on this dataset; and (iv) actionable insights and recommendations for integrating LLMs into software testing education. These findings highlight the promise of LLMs in supporting ISTQB certification preparation and offer a foundation for their broader use in software engineering at higher education. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_22318 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Harnessing the Power of Large Language Models for Software Testing Education: A Focus on ISTQB Syllabus Ngo, Tuan-Phong Duong, Bao-Ngoc Hoang, Tuan-Anh Dwight, Joshua Khwakhali, Ushik Shrestha Software Engineering Artificial Intelligence K.3.2, D.2.5 Software testing is a critical component in the software engineering field and is important for software engineering education. Thus, it is vital for academia to continuously improve and update educational methods to reflect the current state of the field. The International Software Testing Qualifications Board (ISTQB) certification framework is globally recognized and widely adopted in industry and academia. However, ISTQB-based learning has been rarely applied with recent generative artificial intelligence advances. Despite the growing capabilities of large language models (LLMs), ISTQB-based learning and instruction with LLMs have not been thoroughly explored. This paper explores and evaluates how LLMs can complement the ISTQB framework for higher education. The findings present four key contributions: (i) the creation of a comprehensive ISTQB-aligned dataset spanning over a decade, consisting of 28 sample exams and 1,145 questions; (ii) the development of a domain-optimized prompt that enhances LLM precision and explanation quality on ISTQB tasks; (iii) a systematic evaluation of state-of-the-art LLMs on this dataset; and (iv) actionable insights and recommendations for integrating LLMs into software testing education. These findings highlight the promise of LLMs in supporting ISTQB certification preparation and offer a foundation for their broader use in software engineering at higher education. |
| title | Harnessing the Power of Large Language Models for Software Testing Education: A Focus on ISTQB Syllabus |
| topic | Software Engineering Artificial Intelligence K.3.2, D.2.5 |
| url | https://arxiv.org/abs/2510.22318 |