Caption-Driven Explainability: Probing CNNs for Bias via CLIP
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911466697785344 |
|---|---|
| author | Koller, Patrick Dravid, Amil V. Schuster, Guido M. Katsaggelos, Aggelos K. |
| author_facet | Koller, Patrick Dravid, Amil V. Schuster, Guido M. Katsaggelos, Aggelos K. |
| contents | Robustness has become one of the most critical problems in machine learning (ML). The science of interpreting ML models to understand their behavior and improve their robustness is referred to as explainable artificial intelligence (XAI). One of the state-of-the-art XAI methods for computer vision problems is to generate saliency maps. A saliency map highlights the pixel space of an image that excites the ML model the most. However, this property could be misleading if spurious and salient features are present in overlapping pixel spaces. In this paper, we propose a caption-based XAI method, which integrates a standalone model to be explained into the contrastive language-image pre-training (CLIP) model using a novel network surgery approach. The resulting caption-based XAI model identifies the dominant concept that contributes the most to the models prediction. This explanation minimizes the risk of the standalone model falling for a covariate shift and contributes significantly towards developing robust ML models. Our code is available at https://github.com/patch0816/caption-driven-xai |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_22035 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Caption-Driven Explainability: Probing CNNs for Bias via CLIP Koller, Patrick Dravid, Amil V. Schuster, Guido M. Katsaggelos, Aggelos K. Computer Vision and Pattern Recognition Image and Video Processing I.2.6; I.2.8; I.2.10; I.4.8 Robustness has become one of the most critical problems in machine learning (ML). The science of interpreting ML models to understand their behavior and improve their robustness is referred to as explainable artificial intelligence (XAI). One of the state-of-the-art XAI methods for computer vision problems is to generate saliency maps. A saliency map highlights the pixel space of an image that excites the ML model the most. However, this property could be misleading if spurious and salient features are present in overlapping pixel spaces. In this paper, we propose a caption-based XAI method, which integrates a standalone model to be explained into the contrastive language-image pre-training (CLIP) model using a novel network surgery approach. The resulting caption-based XAI model identifies the dominant concept that contributes the most to the models prediction. This explanation minimizes the risk of the standalone model falling for a covariate shift and contributes significantly towards developing robust ML models. Our code is available at https://github.com/patch0816/caption-driven-xai |
| title | Caption-Driven Explainability: Probing CNNs for Bias via CLIP |
| topic | Computer Vision and Pattern Recognition Image and Video Processing I.2.6; I.2.8; I.2.10; I.4.8 |
| url | https://arxiv.org/abs/2510.22035 |