Sanity Checks Revisited: An Exploration to Repair the Model Parameter Randomisation Test
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866929207610703872 |
|---|---|
| author | Hedström, Anna Weber, Leander Lapuschkin, Sebastian Höhne, Marina MC |
| author_facet | Hedström, Anna Weber, Leander Lapuschkin, Sebastian Höhne, Marina MC |
| contents | The Model Parameter Randomisation Test (MPRT) is widely acknowledged in the eXplainable Artificial Intelligence (XAI) community for its well-motivated evaluative principle: that the explanation function should be sensitive to changes in the parameters of the model function. However, recent works have identified several methodological caveats for the empirical interpretation of MPRT. To address these caveats, we introduce two adaptations to the original MPRT -- Smooth MPRT and Efficient MPRT, where the former minimises the impact that noise has on the evaluation results through sampling and the latter circumvents the need for biased similarity measurements by re-interpreting the test through the explanation's rise in complexity, after full parameter randomisation. Our experimental results demonstrate that these proposed variants lead to improved metric reliability, thus enabling a more trustworthy application of XAI methods. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_06465 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Sanity Checks Revisited: An Exploration to Repair the Model Parameter Randomisation Test Hedström, Anna Weber, Leander Lapuschkin, Sebastian Höhne, Marina MC Artificial Intelligence Machine Learning Methodology The Model Parameter Randomisation Test (MPRT) is widely acknowledged in the eXplainable Artificial Intelligence (XAI) community for its well-motivated evaluative principle: that the explanation function should be sensitive to changes in the parameters of the model function. However, recent works have identified several methodological caveats for the empirical interpretation of MPRT. To address these caveats, we introduce two adaptations to the original MPRT -- Smooth MPRT and Efficient MPRT, where the former minimises the impact that noise has on the evaluation results through sampling and the latter circumvents the need for biased similarity measurements by re-interpreting the test through the explanation's rise in complexity, after full parameter randomisation. Our experimental results demonstrate that these proposed variants lead to improved metric reliability, thus enabling a more trustworthy application of XAI methods. |
| title | Sanity Checks Revisited: An Exploration to Repair the Model Parameter Randomisation Test |
| topic | Artificial Intelligence Machine Learning Methodology |
| url | https://arxiv.org/abs/2401.06465 |