SDHSI-Net: Learning Better Representations for Hyperspectral Images via Self-Distillation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917196043649024 |
|---|---|
| author | Singh, Prachet Dev Paramasivam, Shyamsundar Barman, Sneha Singha, Mainak Jha, Ankit Mishra, Girish Banerjee, Biplab |
| author_facet | Singh, Prachet Dev Paramasivam, Shyamsundar Barman, Sneha Singha, Mainak Jha, Ankit Mishra, Girish Banerjee, Biplab |
| contents | Hyperspectral image (HSI) classification presents unique challenges due to its high spectral dimensionality and limited labeled data. Traditional deep learning models often suffer from overfitting and high computational costs. Self-distillation (SD), a variant of knowledge distillation where a network learns from its own predictions, has recently emerged as a promising strategy to enhance model performance without requiring external teacher networks. In this work, we explore the application of SD to HSI by treating earlier outputs as soft targets, thereby enforcing consistency between intermediate and final predictions. This process improves intra-class compactness and inter-class separability in the learned feature space. Our approach is validated on two benchmark HSI datasets and demonstrates significant improvements in classification accuracy and robustness, highlighting the effectiveness of SD for spectral-spatial learning. Codes are available at https://github.com/Prachet-Dev-Singh/SDHSI. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_07416 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | SDHSI-Net: Learning Better Representations for Hyperspectral Images via Self-Distillation Singh, Prachet Dev Paramasivam, Shyamsundar Barman, Sneha Singha, Mainak Jha, Ankit Mishra, Girish Banerjee, Biplab Computer Vision and Pattern Recognition Hyperspectral image (HSI) classification presents unique challenges due to its high spectral dimensionality and limited labeled data. Traditional deep learning models often suffer from overfitting and high computational costs. Self-distillation (SD), a variant of knowledge distillation where a network learns from its own predictions, has recently emerged as a promising strategy to enhance model performance without requiring external teacher networks. In this work, we explore the application of SD to HSI by treating earlier outputs as soft targets, thereby enforcing consistency between intermediate and final predictions. This process improves intra-class compactness and inter-class separability in the learned feature space. Our approach is validated on two benchmark HSI datasets and demonstrates significant improvements in classification accuracy and robustness, highlighting the effectiveness of SD for spectral-spatial learning. Codes are available at https://github.com/Prachet-Dev-Singh/SDHSI. |
| title | SDHSI-Net: Learning Better Representations for Hyperspectral Images via Self-Distillation |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2601.07416 |