A New Baseline Assumption of Integated Gradients Based on Shaply value
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916250796425216 |
|---|---|
| author | Liu, Shuyang Chen, Zixuan Shi, Ge Wang, Ji Fan, Changjie Xiong, Yu Hu, Runze Wu Yujing Ji, Ze Gao, Yang |
| author_facet | Liu, Shuyang Chen, Zixuan Shi, Ge Wang, Ji Fan, Changjie Xiong, Yu Hu, Runze Wu Yujing Ji, Ze Gao, Yang |
| contents | Efforts to decode deep neural networks (DNNs) often involve mapping their predictions back to the input features. Among these methods, Integrated Gradients (IG) has emerged as a significant technique. The selection of appropriate baselines in IG is crucial for crafting meaningful and unbiased explanations of model predictions in diverse settings. The standard approach of utilizing a single baseline, however, is frequently inadequate, prompting the need for multiple baselines. Leveraging the natural link between IG and the Aumann-Shapley Value, we provide a novel outlook on baseline design. Theoretically, we demonstrate that under certain assumptions, a collection of baselines aligns with the coalitions described by the Shapley Value. Building on this insight, we develop a new baseline method called Shapley Integrated Gradients (SIG), which uses proportional sampling to mirror the Shapley Value computation process. Simulations conducted in GridWorld validate that SIG effectively emulates the distribution of Shapley Values. Moreover, empirical tests on various image processing tasks show that SIG surpasses traditional IG baseline methods by offering more precise estimates of feature contributions, providing consistent explanations across different applications, and ensuring adaptability to diverse data types with negligible additional computational demand. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_04821 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | A New Baseline Assumption of Integated Gradients Based on Shaply value Liu, Shuyang Chen, Zixuan Shi, Ge Wang, Ji Fan, Changjie Xiong, Yu Hu, Runze Wu Yujing Ji, Ze Gao, Yang Machine Learning Artificial Intelligence Efforts to decode deep neural networks (DNNs) often involve mapping their predictions back to the input features. Among these methods, Integrated Gradients (IG) has emerged as a significant technique. The selection of appropriate baselines in IG is crucial for crafting meaningful and unbiased explanations of model predictions in diverse settings. The standard approach of utilizing a single baseline, however, is frequently inadequate, prompting the need for multiple baselines. Leveraging the natural link between IG and the Aumann-Shapley Value, we provide a novel outlook on baseline design. Theoretically, we demonstrate that under certain assumptions, a collection of baselines aligns with the coalitions described by the Shapley Value. Building on this insight, we develop a new baseline method called Shapley Integrated Gradients (SIG), which uses proportional sampling to mirror the Shapley Value computation process. Simulations conducted in GridWorld validate that SIG effectively emulates the distribution of Shapley Values. Moreover, empirical tests on various image processing tasks show that SIG surpasses traditional IG baseline methods by offering more precise estimates of feature contributions, providing consistent explanations across different applications, and ensuring adaptability to diverse data types with negligible additional computational demand. |
| title | A New Baseline Assumption of Integated Gradients Based on Shaply value |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2310.04821 |