Exploring Self-Attention for Crop-type Classification Explainability
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917990806585344 |
|---|---|
| author | Obadic, Ivica Roscher, Ribana Oliveira, Dario Augusto Borges Zhu, Xiao Xiang |
| author_facet | Obadic, Ivica Roscher, Ribana Oliveira, Dario Augusto Borges Zhu, Xiao Xiang |
| contents | Transformer models have become a promising approach for crop-type classification. Although their attention weights can be used to understand the relevant time points for crop disambiguation, the validity of these insights depends on how closely the attention weights approximate the actual workings of these black-box models, which is not always clear. In this paper, we introduce a novel explainability framework that systematically evaluates the explanatory power of the attention weights of a standard transformer encoder for crop-type classification. Our results show that attention patterns strongly relate to key dates, which are often associated with critical phenological events for crop-type classification. Further, the sensitivity analysis reveals the limited capability of the attention weights to characterize crop phenology as the identified phenological events depend on the other crops considered during training. This limitation highlights the relevance of future work towards the development of deep learning approaches capable of automatically learning the temporal vegetation dynamics for accurate crop disambiguation |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2210_13167 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | Exploring Self-Attention for Crop-type Classification Explainability Obadic, Ivica Roscher, Ribana Oliveira, Dario Augusto Borges Zhu, Xiao Xiang Computer Vision and Pattern Recognition Transformer models have become a promising approach for crop-type classification. Although their attention weights can be used to understand the relevant time points for crop disambiguation, the validity of these insights depends on how closely the attention weights approximate the actual workings of these black-box models, which is not always clear. In this paper, we introduce a novel explainability framework that systematically evaluates the explanatory power of the attention weights of a standard transformer encoder for crop-type classification. Our results show that attention patterns strongly relate to key dates, which are often associated with critical phenological events for crop-type classification. Further, the sensitivity analysis reveals the limited capability of the attention weights to characterize crop phenology as the identified phenological events depend on the other crops considered during training. This limitation highlights the relevance of future work towards the development of deep learning approaches capable of automatically learning the temporal vegetation dynamics for accurate crop disambiguation |
| title | Exploring Self-Attention for Crop-type Classification Explainability |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2210.13167 |