Data-centric Prediction Explanation via Kernelized Stein Discrepancy

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sarvmaili, Mahtab, Sajjad, Hassan, Wu, Ga
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913842990153728
author Sarvmaili, Mahtab
Sajjad, Hassan
Wu, Ga
author_facet Sarvmaili, Mahtab
Sajjad, Hassan
Wu, Ga
contents Existing example-based prediction explanation methods often bridge test and training data points through the model's parameters or latent representations. While these methods offer clues to the causes of model predictions, they often exhibit innate shortcomings, such as incurring significant computational overhead or producing coarse-grained explanations. This paper presents a Highly-precise and Data-centric Explan}ation (HD-Explain) prediction explanation method that exploits properties of Kernelized Stein Discrepancy (KSD). Specifically, the KSD uniquely defines a parameterized kernel function for a trained model that encodes model-dependent data correlation. By leveraging the kernel function, one can identify training samples that provide the best predictive support to a test point efficiently. We conducted thorough analyses and experiments across multiple classification domains, where we show that HD-Explain outperforms existing methods from various aspects, including 1) preciseness (fine-grained explanation), 2) consistency, and 3) computation efficiency, leading to a surprisingly simple, effective, and robust prediction explanation solution.
format Preprint
id arxiv_https___arxiv_org_abs_2403_15576
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Data-centric Prediction Explanation via Kernelized Stein Discrepancy
Sarvmaili, Mahtab
Sajjad, Hassan
Wu, Ga
Machine Learning
Computer Vision and Pattern Recognition
Existing example-based prediction explanation methods often bridge test and training data points through the model's parameters or latent representations. While these methods offer clues to the causes of model predictions, they often exhibit innate shortcomings, such as incurring significant computational overhead or producing coarse-grained explanations. This paper presents a Highly-precise and Data-centric Explan}ation (HD-Explain) prediction explanation method that exploits properties of Kernelized Stein Discrepancy (KSD). Specifically, the KSD uniquely defines a parameterized kernel function for a trained model that encodes model-dependent data correlation. By leveraging the kernel function, one can identify training samples that provide the best predictive support to a test point efficiently. We conducted thorough analyses and experiments across multiple classification domains, where we show that HD-Explain outperforms existing methods from various aspects, including 1) preciseness (fine-grained explanation), 2) consistency, and 3) computation efficiency, leading to a surprisingly simple, effective, and robust prediction explanation solution.
title Data-centric Prediction Explanation via Kernelized Stein Discrepancy
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.15576