CAPE: CAM as a Probabilistic Ensemble for Enhanced DNN Interpretation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914740489420800 |
|---|---|
| author | Chowdhury, Townim Faisal Liao, Kewen Phan, Vu Minh Hieu To, Minh-Son Xie, Yutong Hung, Kevin Ross, David Hengel, Anton van den Verjans, Johan W. Liao, Zhibin |
| author_facet | Chowdhury, Townim Faisal Liao, Kewen Phan, Vu Minh Hieu To, Minh-Son Xie, Yutong Hung, Kevin Ross, David Hengel, Anton van den Verjans, Johan W. Liao, Zhibin |
| contents | Deep Neural Networks (DNNs) are widely used for visual classification tasks, but their complex computation process and black-box nature hinder decision transparency and interpretability. Class activation maps (CAMs) and recent variants provide ways to visually explain the DNN decision-making process by displaying 'attention' heatmaps of the DNNs. Nevertheless, the CAM explanation only offers relative attention information, that is, on an attention heatmap, we can interpret which image region is more or less important than the others. However, these regions cannot be meaningfully compared across classes, and the contribution of each region to the model's class prediction is not revealed. To address these challenges that ultimately lead to better DNN Interpretation, in this paper, we propose CAPE, a novel reformulation of CAM that provides a unified and probabilistically meaningful assessment of the contributions of image regions. We quantitatively and qualitatively compare CAPE with state-of-the-art CAM methods on CUB and ImageNet benchmark datasets to demonstrate enhanced interpretability. We also test on a cytology imaging dataset depicting a challenging Chronic Myelomonocytic Leukemia (CMML) diagnosis problem. Code is available at: https://github.com/AIML-MED/CAPE. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_02388 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | CAPE: CAM as a Probabilistic Ensemble for Enhanced DNN Interpretation Chowdhury, Townim Faisal Liao, Kewen Phan, Vu Minh Hieu To, Minh-Son Xie, Yutong Hung, Kevin Ross, David Hengel, Anton van den Verjans, Johan W. Liao, Zhibin Computer Vision and Pattern Recognition Deep Neural Networks (DNNs) are widely used for visual classification tasks, but their complex computation process and black-box nature hinder decision transparency and interpretability. Class activation maps (CAMs) and recent variants provide ways to visually explain the DNN decision-making process by displaying 'attention' heatmaps of the DNNs. Nevertheless, the CAM explanation only offers relative attention information, that is, on an attention heatmap, we can interpret which image region is more or less important than the others. However, these regions cannot be meaningfully compared across classes, and the contribution of each region to the model's class prediction is not revealed. To address these challenges that ultimately lead to better DNN Interpretation, in this paper, we propose CAPE, a novel reformulation of CAM that provides a unified and probabilistically meaningful assessment of the contributions of image regions. We quantitatively and qualitatively compare CAPE with state-of-the-art CAM methods on CUB and ImageNet benchmark datasets to demonstrate enhanced interpretability. We also test on a cytology imaging dataset depicting a challenging Chronic Myelomonocytic Leukemia (CMML) diagnosis problem. Code is available at: https://github.com/AIML-MED/CAPE. |
| title | CAPE: CAM as a Probabilistic Ensemble for Enhanced DNN Interpretation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2404.02388 |