From Bugs to Benchmarks: A Comprehensive Survey of Software Defect Datasets
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866918331589591040 |
|---|---|
| author | Zhu, Hao-Nan Furth, Robert M. Pradel, Michael Rubio-González, Cindy |
| author_facet | Zhu, Hao-Nan Furth, Robert M. Pradel, Michael Rubio-González, Cindy |
| contents | Software defect datasets, which are collections of software bugs, are essential resources to facilitate empirical research and enable standardized benchmarking for a wide range of software engineering techniques, including emerging areas like agentic AI-based software development. Over the years, numerous software defect datasets have been developed, providing rich resources for the community, yet making it increasingly difficult to navigate the landscape. This article provides a comprehensive survey of 151 software defect datasets, covering their scope, construction, availability, usability, and practical uses. We also suggest potential opportunities for future research based on our findings, such as addressing underrepresented kinds of defects. A complete catalog of all surveyed software defect datasets is available at https://defect-datasets.github.io/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_17977 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | From Bugs to Benchmarks: A Comprehensive Survey of Software Defect Datasets Zhu, Hao-Nan Furth, Robert M. Pradel, Michael Rubio-González, Cindy Software Engineering Software defect datasets, which are collections of software bugs, are essential resources to facilitate empirical research and enable standardized benchmarking for a wide range of software engineering techniques, including emerging areas like agentic AI-based software development. Over the years, numerous software defect datasets have been developed, providing rich resources for the community, yet making it increasingly difficult to navigate the landscape. This article provides a comprehensive survey of 151 software defect datasets, covering their scope, construction, availability, usability, and practical uses. We also suggest potential opportunities for future research based on our findings, such as addressing underrepresented kinds of defects. A complete catalog of all surveyed software defect datasets is available at https://defect-datasets.github.io/. |
| title | From Bugs to Benchmarks: A Comprehensive Survey of Software Defect Datasets |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2504.17977 |