Causes and Effects of Fitness Landscapes in System Test Generation: A Replication Study

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Sahin, Omur, Zhang, Man, Arcuri, Andrea
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909796604575744
author Sahin, Omur
Zhang, Man
Arcuri, Andrea
author_facet Sahin, Omur
Zhang, Man
Arcuri, Andrea
contents Search-Based Software Testing (SBST) has seen several success stories in academia and industry. The effectiveness of a search algorithm at solving a software engineering problem strongly depends on how such algorithm can navigate the fitness landscape of the addressed problem. The fitness landscape depends on the used fitness function. Understanding the properties of a fitness landscape can help to provide insight on how a search algorithm behaves on it. Such insight can provide valuable information to researchers to being able to design novel, more effective search algorithms and fitness functions tailored for a specific problem. Due to its importance, few fitness landscape analyses have been carried out in the scientific literature of SBST. However, those have been focusing on the problem of unit test generation, e.g., with state-of-the-art tools such as EvoSuite. In this paper, we replicate one such existing study. However, in our work we focus on system test generation, with the state-of-the-art tool EvoMaster. Based on an empirical study involving the testing of 23 web services, this enables us to provide valuable insight into this important testing domain of practical industrial relevance.
format Preprint
id arxiv_https___arxiv_org_abs_2502_00169
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Causes and Effects of Fitness Landscapes in System Test Generation: A Replication Study
Sahin, Omur
Zhang, Man
Arcuri, Andrea
Software Engineering
Search-Based Software Testing (SBST) has seen several success stories in academia and industry. The effectiveness of a search algorithm at solving a software engineering problem strongly depends on how such algorithm can navigate the fitness landscape of the addressed problem. The fitness landscape depends on the used fitness function. Understanding the properties of a fitness landscape can help to provide insight on how a search algorithm behaves on it. Such insight can provide valuable information to researchers to being able to design novel, more effective search algorithms and fitness functions tailored for a specific problem. Due to its importance, few fitness landscape analyses have been carried out in the scientific literature of SBST. However, those have been focusing on the problem of unit test generation, e.g., with state-of-the-art tools such as EvoSuite. In this paper, we replicate one such existing study. However, in our work we focus on system test generation, with the state-of-the-art tool EvoMaster. Based on an empirical study involving the testing of 23 web services, this enables us to provide valuable insight into this important testing domain of practical industrial relevance.
title Causes and Effects of Fitness Landscapes in System Test Generation: A Replication Study
topic Software Engineering
url https://arxiv.org/abs/2502.00169