A mixed-categorical correlation kernel for Gaussian process

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Saves, P., Diouane, Y., Bartoli, N., Lefebvre, T., Morlier, J.
Format: Preprint
Veröffentlicht: 2022
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917572895571968
author Saves, P.
Diouane, Y.
Bartoli, N.
Lefebvre, T.
Morlier, J.
author_facet Saves, P.
Diouane, Y.
Bartoli, N.
Lefebvre, T.
Morlier, J.
contents Recently, there has been a growing interest for mixed-categorical meta-models based on Gaussian process (GP) surrogates. In this setting, several existing approaches use different strategies either by using continuous kernels (e.g., continuous relaxation and Gower distance based GP) or by using a direct estimation of the correlation matrix. In this paper, we present a kernel-based approach that extends continuous exponential kernels to handle mixed-categorical variables. The proposed kernel leads to a new GP surrogate that generalizes both the continuous relaxation and the Gower distance based GP models. We demonstrate, on both analytical and engineering problems, that our proposed GP model gives a higher likelihood and a smaller residual error than the other kernel-based state-of-the-art models. Our method is available in the open-source software SMT.
format Preprint
id arxiv_https___arxiv_org_abs_2211_08262
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle A mixed-categorical correlation kernel for Gaussian process
Saves, P.
Diouane, Y.
Bartoli, N.
Lefebvre, T.
Morlier, J.
Optimization and Control
Machine Learning
Recently, there has been a growing interest for mixed-categorical meta-models based on Gaussian process (GP) surrogates. In this setting, several existing approaches use different strategies either by using continuous kernels (e.g., continuous relaxation and Gower distance based GP) or by using a direct estimation of the correlation matrix. In this paper, we present a kernel-based approach that extends continuous exponential kernels to handle mixed-categorical variables. The proposed kernel leads to a new GP surrogate that generalizes both the continuous relaxation and the Gower distance based GP models. We demonstrate, on both analytical and engineering problems, that our proposed GP model gives a higher likelihood and a smaller residual error than the other kernel-based state-of-the-art models. Our method is available in the open-source software SMT.
title A mixed-categorical correlation kernel for Gaussian process
topic Optimization and Control
Machine Learning
url https://arxiv.org/abs/2211.08262