Expected Grad-CAM: Towards gradient faithfulness

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Buono, Vincenzo, Mashhadi, Peyman Sheikholharam, Rahat, Mahmoud, Tiwari, Prayag, Byttner, Stefan
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913405343891456
author Buono, Vincenzo
Mashhadi, Peyman Sheikholharam
Rahat, Mahmoud
Tiwari, Prayag
Byttner, Stefan
author_facet Buono, Vincenzo
Mashhadi, Peyman Sheikholharam
Rahat, Mahmoud
Tiwari, Prayag
Byttner, Stefan
contents Although input-gradients techniques have evolved to mitigate and tackle the challenges associated with gradients, modern gradient-weighted CAM approaches still rely on vanilla gradients, which are inherently susceptible to the saturation phenomena. Despite recent enhancements have incorporated counterfactual gradient strategies as a mitigating measure, these local explanation techniques still exhibit a lack of sensitivity to their baseline parameter. Our work proposes a gradient-weighted CAM augmentation that tackles both the saturation and sensitivity problem by reshaping the gradient computation, incorporating two well-established and provably approaches: Expected Gradients and kernel smoothing. By revisiting the original formulation as the smoothed expectation of the perturbed integrated gradients, one can concurrently construct more faithful, localized and robust explanations which minimize infidelity. Through fine modulation of the perturbation distribution it is possible to regulate the complexity characteristic of the explanation, selectively discriminating stable features. Our technique, Expected Grad-CAM, differently from recent works, exclusively optimizes the gradient computation, purposefully designed as an enhanced substitute of the foundational Grad-CAM algorithm and any method built therefrom. Quantitative and qualitative evaluations have been conducted to assess the effectiveness of our method.
format Preprint
id arxiv_https___arxiv_org_abs_2406_01274
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Expected Grad-CAM: Towards gradient faithfulness
Buono, Vincenzo
Mashhadi, Peyman Sheikholharam
Rahat, Mahmoud
Tiwari, Prayag
Byttner, Stefan
Machine Learning
Computer Vision and Pattern Recognition
Although input-gradients techniques have evolved to mitigate and tackle the challenges associated with gradients, modern gradient-weighted CAM approaches still rely on vanilla gradients, which are inherently susceptible to the saturation phenomena. Despite recent enhancements have incorporated counterfactual gradient strategies as a mitigating measure, these local explanation techniques still exhibit a lack of sensitivity to their baseline parameter. Our work proposes a gradient-weighted CAM augmentation that tackles both the saturation and sensitivity problem by reshaping the gradient computation, incorporating two well-established and provably approaches: Expected Gradients and kernel smoothing. By revisiting the original formulation as the smoothed expectation of the perturbed integrated gradients, one can concurrently construct more faithful, localized and robust explanations which minimize infidelity. Through fine modulation of the perturbation distribution it is possible to regulate the complexity characteristic of the explanation, selectively discriminating stable features. Our technique, Expected Grad-CAM, differently from recent works, exclusively optimizes the gradient computation, purposefully designed as an enhanced substitute of the foundational Grad-CAM algorithm and any method built therefrom. Quantitative and qualitative evaluations have been conducted to assess the effectiveness of our method.
title Expected Grad-CAM: Towards gradient faithfulness
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.01274