Discrete Wavelet Transform-Based Capsule Network for Hyperspectral Image Classification

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gao, Zhiqiang, Wang, Jiaqi, Shen, Hangchi, Dou, Zhihao, Zhang, Xiangbo, Huang, Kaizhu
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909451724783616
author Gao, Zhiqiang
Wang, Jiaqi
Shen, Hangchi
Dou, Zhihao
Zhang, Xiangbo
Huang, Kaizhu
author_facet Gao, Zhiqiang
Wang, Jiaqi
Shen, Hangchi
Dou, Zhihao
Zhang, Xiangbo
Huang, Kaizhu
contents Hyperspectral image (HSI) classification is a crucial technique for remote sensing to build large-scale earth monitoring systems. HSI contains much more information than traditional visual images for identifying the categories of land covers. One recent feasible solution for HSI is to leverage CapsNets for capturing spectral-spatial information. However, these methods require high computational requirements due to the full connection architecture between stacked capsule layers. To solve this problem, a DWT-CapsNet is proposed to identify partial but important connections in CapsNet for a effective and efficient HSI classification. Specifically, we integrate a tailored attention mechanism into a Discrete Wavelet Transform (DWT)-based downsampling layer, alleviating the information loss problem of conventional downsampling operation in feature extractors. Moreover, we propose a novel multi-scale routing algorithm that prunes a large proportion of connections in CapsNet. A capsule pyramid fusion mechanism is designed to aggregate the spectral-spatial relationships in multiple levels of granularity, and then a self-attention mechanism is further conducted in a partially and locally connected architecture to emphasize the meaningful relationships. As shown in the experimental results, our method achieves state-of-the-art accuracy while keeping lower computational demand regarding running time, flops, and the number of parameters, rendering it an appealing choice for practical implementation in HSI classification.
format Preprint
id arxiv_https___arxiv_org_abs_2501_04643
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Discrete Wavelet Transform-Based Capsule Network for Hyperspectral Image Classification
Gao, Zhiqiang
Wang, Jiaqi
Shen, Hangchi
Dou, Zhihao
Zhang, Xiangbo
Huang, Kaizhu
Computer Vision and Pattern Recognition
Hyperspectral image (HSI) classification is a crucial technique for remote sensing to build large-scale earth monitoring systems. HSI contains much more information than traditional visual images for identifying the categories of land covers. One recent feasible solution for HSI is to leverage CapsNets for capturing spectral-spatial information. However, these methods require high computational requirements due to the full connection architecture between stacked capsule layers. To solve this problem, a DWT-CapsNet is proposed to identify partial but important connections in CapsNet for a effective and efficient HSI classification. Specifically, we integrate a tailored attention mechanism into a Discrete Wavelet Transform (DWT)-based downsampling layer, alleviating the information loss problem of conventional downsampling operation in feature extractors. Moreover, we propose a novel multi-scale routing algorithm that prunes a large proportion of connections in CapsNet. A capsule pyramid fusion mechanism is designed to aggregate the spectral-spatial relationships in multiple levels of granularity, and then a self-attention mechanism is further conducted in a partially and locally connected architecture to emphasize the meaningful relationships. As shown in the experimental results, our method achieves state-of-the-art accuracy while keeping lower computational demand regarding running time, flops, and the number of parameters, rendering it an appealing choice for practical implementation in HSI classification.
title Discrete Wavelet Transform-Based Capsule Network for Hyperspectral Image Classification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.04643