FuzzAug: Data Augmentation by Coverage-guided Fuzzing for Neural Test Generation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908424380350464 |
|---|---|
| author | He, Yifeng Wang, Jicheng Rong, Yuyang Chen, Hao |
| author_facet | He, Yifeng Wang, Jicheng Rong, Yuyang Chen, Hao |
| contents | Testing is essential to modern software engineering for building reliable software. Given the high costs of manually creating test cases, automated test case generation, particularly methods utilizing large language models, has become increasingly popular. These neural approaches generate semantically meaningful tests that are more maintainable compared with traditional automatic testing methods like fuzzing. However, the diversity and volume of unit tests in current datasets are limited, especially for newer but important languages. In this paper, we present a novel data augmentation technique, FuzzAug, that introduces the benefits of fuzzing to large language models by introducing valid testing semantics and providing diverse coverage-guided inputs. Doubling the size of training datasets, FuzzAug improves the performance from the baselines significantly. This technique demonstrates the potential of introducing prior knowledge from dynamic software analysis to improve neural test generation, offering significant enhancements in neural test generation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_08665 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FuzzAug: Data Augmentation by Coverage-guided Fuzzing for Neural Test Generation He, Yifeng Wang, Jicheng Rong, Yuyang Chen, Hao Software Engineering Artificial Intelligence Testing is essential to modern software engineering for building reliable software. Given the high costs of manually creating test cases, automated test case generation, particularly methods utilizing large language models, has become increasingly popular. These neural approaches generate semantically meaningful tests that are more maintainable compared with traditional automatic testing methods like fuzzing. However, the diversity and volume of unit tests in current datasets are limited, especially for newer but important languages. In this paper, we present a novel data augmentation technique, FuzzAug, that introduces the benefits of fuzzing to large language models by introducing valid testing semantics and providing diverse coverage-guided inputs. Doubling the size of training datasets, FuzzAug improves the performance from the baselines significantly. This technique demonstrates the potential of introducing prior knowledge from dynamic software analysis to improve neural test generation, offering significant enhancements in neural test generation. |
| title | FuzzAug: Data Augmentation by Coverage-guided Fuzzing for Neural Test Generation |
| topic | Software Engineering Artificial Intelligence |
| url | https://arxiv.org/abs/2406.08665 |