Improving the efficiency of GP-GOMEA for higher-arity operators

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Schlender, Thalea, Malafaia, Mafalda, Alderliesten, Tanja, Bosman, Peter A. N.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913235065634816
author Schlender, Thalea
Malafaia, Mafalda
Alderliesten, Tanja
Bosman, Peter A. N.
author_facet Schlender, Thalea
Malafaia, Mafalda
Alderliesten, Tanja
Bosman, Peter A. N.
contents Deploying machine learning models into sensitive domains in our society requires these models to be explainable. Genetic Programming (GP) can offer a way to evolve inherently interpretable expressions. GP-GOMEA is a form of GP that has been found particularly effective at evolving expressions that are accurate yet of limited size and, thus, promote interpretability. Despite this strength, a limitation of GP-GOMEA is template-based. This negatively affects its scalability regarding the arity of operators that can be used, since with increasing operator arity, an increasingly large part of the template tends to go unused. In this paper, we therefore propose two enhancements to GP-GOMEA: (i) semantic subtree inheritance, which performs additional variation steps that consider the semantic context of a subtree, and (ii) greedy child selection, which explicitly considers parts of the template that in standard GP-GOMEA remain unused. We compare different versions of GP-GOMEA regarding search enhancements on a set of continuous and discontinuous regression problems, with varying tree depths and operator sets. Experimental results show that both proposed search enhancements have a generally positive impact on the performance of GP-GOMEA, especially when the set of operators to choose from is large and contains higher-arity operators.
format Preprint
id arxiv_https___arxiv_org_abs_2402_09854
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Improving the efficiency of GP-GOMEA for higher-arity operators
Schlender, Thalea
Malafaia, Mafalda
Alderliesten, Tanja
Bosman, Peter A. N.
Neural and Evolutionary Computing
Deploying machine learning models into sensitive domains in our society requires these models to be explainable. Genetic Programming (GP) can offer a way to evolve inherently interpretable expressions. GP-GOMEA is a form of GP that has been found particularly effective at evolving expressions that are accurate yet of limited size and, thus, promote interpretability. Despite this strength, a limitation of GP-GOMEA is template-based. This negatively affects its scalability regarding the arity of operators that can be used, since with increasing operator arity, an increasingly large part of the template tends to go unused. In this paper, we therefore propose two enhancements to GP-GOMEA: (i) semantic subtree inheritance, which performs additional variation steps that consider the semantic context of a subtree, and (ii) greedy child selection, which explicitly considers parts of the template that in standard GP-GOMEA remain unused. We compare different versions of GP-GOMEA regarding search enhancements on a set of continuous and discontinuous regression problems, with varying tree depths and operator sets. Experimental results show that both proposed search enhancements have a generally positive impact on the performance of GP-GOMEA, especially when the set of operators to choose from is large and contains higher-arity operators.
title Improving the efficiency of GP-GOMEA for higher-arity operators
topic Neural and Evolutionary Computing
url https://arxiv.org/abs/2402.09854