Exploring specialization and sensitivity of convolutional neural networks in the context of simultaneous image augmentations
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866917204481540096 |
|---|---|
| author | Kharyuk, Pavel Matveev, Sergey Oseledets, Ivan |
| author_facet | Kharyuk, Pavel Matveev, Sergey Oseledets, Ivan |
| contents | Drawing parallels with the way biological networks are studied, we adapt the treatment--control paradigm to explainable artificial intelligence research and enrich it through multi-parametric input alterations. In this study, we propose a framework for investigating the internal inference impacted by input data augmentations. The internal changes in network operation are reflected in activation changes measured by variance, which can be decomposed into components related to each augmentation, employing Sobol indices and Shapley values. These quantities enable one to visualize sensitivity to different variables and use them for guided masking of activations. In addition, we introduce a way of single-class sensitivity analysis where the candidates are filtered according to their matching to prediction bias generated by targeted damaging of the activations. Relying on the observed parallels, we assume that the developed framework can potentially be transferred to studying biological neural networks in complex environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_03283 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Exploring specialization and sensitivity of convolutional neural networks in the context of simultaneous image augmentations Kharyuk, Pavel Matveev, Sergey Oseledets, Ivan Machine Learning Artificial Intelligence Numerical Analysis 68T07 I.2.6; G.3; I.2.10 Drawing parallels with the way biological networks are studied, we adapt the treatment--control paradigm to explainable artificial intelligence research and enrich it through multi-parametric input alterations. In this study, we propose a framework for investigating the internal inference impacted by input data augmentations. The internal changes in network operation are reflected in activation changes measured by variance, which can be decomposed into components related to each augmentation, employing Sobol indices and Shapley values. These quantities enable one to visualize sensitivity to different variables and use them for guided masking of activations. In addition, we introduce a way of single-class sensitivity analysis where the candidates are filtered according to their matching to prediction bias generated by targeted damaging of the activations. Relying on the observed parallels, we assume that the developed framework can potentially be transferred to studying biological neural networks in complex environments. |
| title | Exploring specialization and sensitivity of convolutional neural networks in the context of simultaneous image augmentations |
| topic | Machine Learning Artificial Intelligence Numerical Analysis 68T07 I.2.6; G.3; I.2.10 |
| url | https://arxiv.org/abs/2503.03283 |