Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Rodemann, Julian, Croppi, Federico, Arens, Philipp, Sale, Yusuf, Herbinger, Julia, Bischl, Bernd, Hüllermeier, Eyke, Augustin, Thomas, Walsh, Conor J., Casalicchio, Giuseppe
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929268456423424
author Rodemann, Julian
Croppi, Federico
Arens, Philipp
Sale, Yusuf
Herbinger, Julia
Bischl, Bernd
Hüllermeier, Eyke
Augustin, Thomas
Walsh, Conor J.
Casalicchio, Giuseppe
author_facet Rodemann, Julian
Croppi, Federico
Arens, Philipp
Sale, Yusuf
Herbinger, Julia
Bischl, Bernd
Hüllermeier, Eyke
Augustin, Thomas
Walsh, Conor J.
Casalicchio, Giuseppe
contents Bayesian optimization (BO) with Gaussian processes (GP) has become an indispensable algorithm for black box optimization problems. Not without a dash of irony, BO is often considered a black box itself, lacking ways to provide reasons as to why certain parameters are proposed to be evaluated. This is particularly relevant in human-in-the-loop applications of BO, such as in robotics. We address this issue by proposing ShapleyBO, a framework for interpreting BO's proposals by game-theoretic Shapley values.They quantify each parameter's contribution to BO's acquisition function. Exploiting the linearity of Shapley values, we are further able to identify how strongly each parameter drives BO's exploration and exploitation for additive acquisition functions like the confidence bound. We also show that ShapleyBO can disentangle the contributions to exploration into those that explore aleatoric and epistemic uncertainty. Moreover, our method gives rise to a ShapleyBO-assisted human machine interface (HMI), allowing users to interfere with BO in case proposals do not align with human reasoning. We demonstrate this HMI's benefits for the use case of personalizing wearable robotic devices (assistive back exosuits) by human-in-the-loop BO. Results suggest human-BO teams with access to ShapleyBO can achieve lower regret than teams without.
format Preprint
id arxiv_https___arxiv_org_abs_2403_04629
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration
Rodemann, Julian
Croppi, Federico
Arens, Philipp
Sale, Yusuf
Herbinger, Julia
Bischl, Bernd
Hüllermeier, Eyke
Augustin, Thomas
Walsh, Conor J.
Casalicchio, Giuseppe
Machine Learning
Artificial Intelligence
Human-Computer Interaction
Robotics
I.2.6; I.2.9; F.2.2; J.6
Bayesian optimization (BO) with Gaussian processes (GP) has become an indispensable algorithm for black box optimization problems. Not without a dash of irony, BO is often considered a black box itself, lacking ways to provide reasons as to why certain parameters are proposed to be evaluated. This is particularly relevant in human-in-the-loop applications of BO, such as in robotics. We address this issue by proposing ShapleyBO, a framework for interpreting BO's proposals by game-theoretic Shapley values.They quantify each parameter's contribution to BO's acquisition function. Exploiting the linearity of Shapley values, we are further able to identify how strongly each parameter drives BO's exploration and exploitation for additive acquisition functions like the confidence bound. We also show that ShapleyBO can disentangle the contributions to exploration into those that explore aleatoric and epistemic uncertainty. Moreover, our method gives rise to a ShapleyBO-assisted human machine interface (HMI), allowing users to interfere with BO in case proposals do not align with human reasoning. We demonstrate this HMI's benefits for the use case of personalizing wearable robotic devices (assistive back exosuits) by human-in-the-loop BO. Results suggest human-BO teams with access to ShapleyBO can achieve lower regret than teams without.
title Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration
topic Machine Learning
Artificial Intelligence
Human-Computer Interaction
Robotics
I.2.6; I.2.9; F.2.2; J.6
url https://arxiv.org/abs/2403.04629