Finding Patterns in Ambiguity: Interpretable Stress Testing in the Decision~Boundary
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916354043412480 |
|---|---|
| author | Gomes, Inês Teixeira, Luís F. van Rijn, Jan N. Soares, Carlos Restivo, André Cunha, Luís Santos, Moisés |
| author_facet | Gomes, Inês Teixeira, Luís F. van Rijn, Jan N. Soares, Carlos Restivo, André Cunha, Luís Santos, Moisés |
| contents | The increasing use of deep learning across various domains highlights the importance of understanding the decision-making processes of these black-box models. Recent research focusing on the decision boundaries of deep classifiers, relies on generated synthetic instances in areas of low confidence, uncovering samples that challenge both models and humans. We propose a novel approach to enhance the interpretability of deep binary classifiers by selecting representative samples from the decision boundary - prototypes - and applying post-model explanation algorithms. We evaluate the effectiveness of our approach through 2D visualizations and GradientSHAP analysis. Our experiments demonstrate the potential of the proposed method, revealing distinct and compact clusters and diverse prototypes that capture essential features that lead to low-confidence decisions. By offering a more aggregated view of deep classifiers' decision boundaries, our work contributes to the responsible development and deployment of reliable machine learning systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_06302 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Finding Patterns in Ambiguity: Interpretable Stress Testing in the Decision~Boundary Gomes, Inês Teixeira, Luís F. van Rijn, Jan N. Soares, Carlos Restivo, André Cunha, Luís Santos, Moisés Machine Learning Computer Vision and Pattern Recognition The increasing use of deep learning across various domains highlights the importance of understanding the decision-making processes of these black-box models. Recent research focusing on the decision boundaries of deep classifiers, relies on generated synthetic instances in areas of low confidence, uncovering samples that challenge both models and humans. We propose a novel approach to enhance the interpretability of deep binary classifiers by selecting representative samples from the decision boundary - prototypes - and applying post-model explanation algorithms. We evaluate the effectiveness of our approach through 2D visualizations and GradientSHAP analysis. Our experiments demonstrate the potential of the proposed method, revealing distinct and compact clusters and diverse prototypes that capture essential features that lead to low-confidence decisions. By offering a more aggregated view of deep classifiers' decision boundaries, our work contributes to the responsible development and deployment of reliable machine learning systems. |
| title | Finding Patterns in Ambiguity: Interpretable Stress Testing in the Decision~Boundary |
| topic | Machine Learning Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2408.06302 |