Test Amplification for REST APIs Using "Out-of-the-box" Large Language Models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913775537356800 |
|---|---|
| author | Bardakci, Tolgahan Demeyer, Serge Beyazit, Mutlu |
| author_facet | Bardakci, Tolgahan Demeyer, Serge Beyazit, Mutlu |
| contents | REST APIs (Representational State Transfer Application Programming Interfaces) are an indispensable building block in today's cloud-native applications, so testing them is critically important. However, writing automated tests for such REST APIs is challenging because one needs strong and readable tests that exercise the boundary values of the protocol embedded in the REST API. In this paper, we report our experience with using "out of the box" large language models (ChatGPT and GitHub's Copilot) to amplify REST API test suites. We compare the resulting tests based on coverage and understandability, and we derive a series of guidelines and lessons learned concerning the prompts that result in the strongest test suite. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_10306 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Test Amplification for REST APIs Using "Out-of-the-box" Large Language Models Bardakci, Tolgahan Demeyer, Serge Beyazit, Mutlu Software Engineering REST APIs (Representational State Transfer Application Programming Interfaces) are an indispensable building block in today's cloud-native applications, so testing them is critically important. However, writing automated tests for such REST APIs is challenging because one needs strong and readable tests that exercise the boundary values of the protocol embedded in the REST API. In this paper, we report our experience with using "out of the box" large language models (ChatGPT and GitHub's Copilot) to amplify REST API test suites. We compare the resulting tests based on coverage and understandability, and we derive a series of guidelines and lessons learned concerning the prompts that result in the strongest test suite. |
| title | Test Amplification for REST APIs Using "Out-of-the-box" Large Language Models |
| topic | Software Engineering |
| url | https://arxiv.org/abs/2503.10306 |