Generational Computation Reduction in Informal Counterexample-Driven Genetic Programming

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Helmuth, Thomas, Pantridge, Edward, Frazier, James Gunder, Spector, Lee
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866913477139890176
author Helmuth, Thomas
Pantridge, Edward
Frazier, James Gunder
Spector, Lee
author_facet Helmuth, Thomas
Pantridge, Edward
Frazier, James Gunder
Spector, Lee
contents Counterexample-driven genetic programming (CDGP) uses specifications provided as formal constraints to generate the training cases used to evaluate evolving programs. It has also been extended to combine formal constraints and user-provided training data to solve symbolic regression problems. Here we show how the ideas underlying CDGP can also be applied using only user-provided training data, without formal specifications. We demonstrate the application of this method, called ``informal CDGP,'' to software synthesis problems. Our results show that informal CDGP finds solutions faster (i.e. with fewer program executions) than standard GP. Additionally, we propose two new variants to informal CDGP, and find that one produces significantly more successful runs on about half of the tested problems. Finally, we study whether the addition of counterexample training cases to the training set is useful by comparing informal CDGP to using a static subsample of the training set, and find that the addition of counterexamples significantly improves performance.
format Preprint
id arxiv_https___arxiv_org_abs_2408_12604
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generational Computation Reduction in Informal Counterexample-Driven Genetic Programming
Helmuth, Thomas
Pantridge, Edward
Frazier, James Gunder
Spector, Lee
Neural and Evolutionary Computing
Artificial Intelligence
Software Engineering
Counterexample-driven genetic programming (CDGP) uses specifications provided as formal constraints to generate the training cases used to evaluate evolving programs. It has also been extended to combine formal constraints and user-provided training data to solve symbolic regression problems. Here we show how the ideas underlying CDGP can also be applied using only user-provided training data, without formal specifications. We demonstrate the application of this method, called ``informal CDGP,'' to software synthesis problems. Our results show that informal CDGP finds solutions faster (i.e. with fewer program executions) than standard GP. Additionally, we propose two new variants to informal CDGP, and find that one produces significantly more successful runs on about half of the tested problems. Finally, we study whether the addition of counterexample training cases to the training set is useful by comparing informal CDGP to using a static subsample of the training set, and find that the addition of counterexamples significantly improves performance.
title Generational Computation Reduction in Informal Counterexample-Driven Genetic Programming
topic Neural and Evolutionary Computing
Artificial Intelligence
Software Engineering
url https://arxiv.org/abs/2408.12604