Vision Mamba-based autonomous crack segmentation on concrete, asphalt, and masonry surfaces
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914847044665344 |
|---|---|
| author | Chen, Zhaohui Shamsabadi, Elyas Asadi Jiang, Sheng Shen, Luming Dias-da-Costa, Daniel |
| author_facet | Chen, Zhaohui Shamsabadi, Elyas Asadi Jiang, Sheng Shen, Luming Dias-da-Costa, Daniel |
| contents | Convolutional neural networks (CNNs) and Transformers have shown advanced accuracy in crack detection under certain conditions. Yet, the fixed local attention can compromise the generalisation of CNNs, and the quadratic complexity of the global self-attention restricts the practical deployment of Transformers. Given the emergence of the new-generation architecture of Mamba, this paper proposes a Vision Mamba (VMamba)-based framework for crack segmentation on concrete, asphalt, and masonry surfaces, with high accuracy, generalisation, and less computational complexity. Having 15.6% - 74.5% fewer parameters, the encoder-decoder network integrated with VMamba could obtain up to 2.8% higher mDS than representative CNN-based models while showing about the same performance as Transformer-based models. Moreover, the VMamba-based encoder-decoder network could process high-resolution image input with up to 90.6% lower floating-point operations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_16518 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Vision Mamba-based autonomous crack segmentation on concrete, asphalt, and masonry surfaces Chen, Zhaohui Shamsabadi, Elyas Asadi Jiang, Sheng Shen, Luming Dias-da-Costa, Daniel Computer Vision and Pattern Recognition Convolutional neural networks (CNNs) and Transformers have shown advanced accuracy in crack detection under certain conditions. Yet, the fixed local attention can compromise the generalisation of CNNs, and the quadratic complexity of the global self-attention restricts the practical deployment of Transformers. Given the emergence of the new-generation architecture of Mamba, this paper proposes a Vision Mamba (VMamba)-based framework for crack segmentation on concrete, asphalt, and masonry surfaces, with high accuracy, generalisation, and less computational complexity. Having 15.6% - 74.5% fewer parameters, the encoder-decoder network integrated with VMamba could obtain up to 2.8% higher mDS than representative CNN-based models while showing about the same performance as Transformer-based models. Moreover, the VMamba-based encoder-decoder network could process high-resolution image input with up to 90.6% lower floating-point operations. |
| title | Vision Mamba-based autonomous crack segmentation on concrete, asphalt, and masonry surfaces |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2406.16518 |