ContextualSHAP : Enhancing SHAP Explanations Through Contextual Language Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Dwiyanti, Latifa, Wibisono, Sergio Ryan, Nambo, Hidetaka
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915935693045760
author Dwiyanti, Latifa
Wibisono, Sergio Ryan
Nambo, Hidetaka
author_facet Dwiyanti, Latifa
Wibisono, Sergio Ryan
Nambo, Hidetaka
contents Explainable Artificial Intelligence (XAI) has become an increasingly important area of research, particularly as machine learning models are deployed in high-stakes domains. Among various XAI approaches, SHAP (SHapley Additive exPlanations) has gained prominence due to its ability to provide both global and local explanations across different machine learning models. While SHAP effectively visualizes feature importance, it often lacks contextual explanations that are meaningful for end-users, especially those without technical backgrounds. To address this gap, we propose a Python package that extends SHAP by integrating it with a large language model (LLM), specifically OpenAI's GPT, to generate contextualized textual explanations. This integration is guided by user-defined parameters (such as feature aliases, descriptions, and additional background) to tailor the explanation to both the model context and the user perspective. We hypothesize that this enhancement can improve the perceived understandability of SHAP explanations. To evaluate the effectiveness of the proposed package, we applied it in a healthcare-related case study and conducted user evaluations involving real end-users. The results, based on Likert-scale surveys and follow-up interviews, indicate that the generated explanations were perceived as more understandable and contextually appropriate compared to visual-only outputs. While the findings are preliminary, they suggest that combining visualization with contextualized text may support more user-friendly and trustworthy model explanations.
format Preprint
id arxiv_https___arxiv_org_abs_2512_07178
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ContextualSHAP : Enhancing SHAP Explanations Through Contextual Language Generation
Dwiyanti, Latifa
Wibisono, Sergio Ryan
Nambo, Hidetaka
Artificial Intelligence
Human-Computer Interaction
Machine Learning
Explainable Artificial Intelligence (XAI) has become an increasingly important area of research, particularly as machine learning models are deployed in high-stakes domains. Among various XAI approaches, SHAP (SHapley Additive exPlanations) has gained prominence due to its ability to provide both global and local explanations across different machine learning models. While SHAP effectively visualizes feature importance, it often lacks contextual explanations that are meaningful for end-users, especially those without technical backgrounds. To address this gap, we propose a Python package that extends SHAP by integrating it with a large language model (LLM), specifically OpenAI's GPT, to generate contextualized textual explanations. This integration is guided by user-defined parameters (such as feature aliases, descriptions, and additional background) to tailor the explanation to both the model context and the user perspective. We hypothesize that this enhancement can improve the perceived understandability of SHAP explanations. To evaluate the effectiveness of the proposed package, we applied it in a healthcare-related case study and conducted user evaluations involving real end-users. The results, based on Likert-scale surveys and follow-up interviews, indicate that the generated explanations were perceived as more understandable and contextually appropriate compared to visual-only outputs. While the findings are preliminary, they suggest that combining visualization with contextualized text may support more user-friendly and trustworthy model explanations.
title ContextualSHAP : Enhancing SHAP Explanations Through Contextual Language Generation
topic Artificial Intelligence
Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2512.07178