Tests4Py: A Benchmark for System Testing
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913349561745408 |
|---|---|
| author | Smytzek, Marius Eberlein, Martin Serce, Batuhan Grunske, Lars Zeller, Andreas |
| author_facet | Smytzek, Marius Eberlein, Martin Serce, Batuhan Grunske, Lars Zeller, Andreas |
| contents | Benchmarks are among the main drivers of progress in software engineering research. However, many current benchmarks are limited by inadequate system oracles and sparse unit tests. Our Tests4Py benchmark, derived from the BugsInPy benchmark, addresses these limitations. It includes 73 bugs from seven real-world Python applications and six bugs from example programs. Each subject in Tests4Py is equipped with an oracle for verifying functional correctness and supports both system and unit test generation. This allows for comprehensive qualitative studies and extensive evaluations, making Tests4Py a cutting-edge benchmark for research in test generation, debugging, and automatic program repair. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_05147 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Tests4Py: A Benchmark for System Testing Smytzek, Marius Eberlein, Martin Serce, Batuhan Grunske, Lars Zeller, Andreas Software Engineering D.2.5; D.2.13 Benchmarks are among the main drivers of progress in software engineering research. However, many current benchmarks are limited by inadequate system oracles and sparse unit tests. Our Tests4Py benchmark, derived from the BugsInPy benchmark, addresses these limitations. It includes 73 bugs from seven real-world Python applications and six bugs from example programs. Each subject in Tests4Py is equipped with an oracle for verifying functional correctness and supports both system and unit test generation. This allows for comprehensive qualitative studies and extensive evaluations, making Tests4Py a cutting-edge benchmark for research in test generation, debugging, and automatic program repair. |
| title | Tests4Py: A Benchmark for System Testing |
| topic | Software Engineering D.2.5; D.2.13 |
| url | https://arxiv.org/abs/2307.05147 |