A Hierarchical Self-Consistent Regularization Approach to Satellite Image Time Series Classification

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Weikmann, Giulio, Perantoni, Gianmarco, Bruzzone, Lorenzo
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911624593408000
author Weikmann, Giulio
Perantoni, Gianmarco
Bruzzone, Lorenzo
author_facet Weikmann, Giulio
Perantoni, Gianmarco
Bruzzone, Lorenzo
contents Deep learning has become increasingly important in remote sensing image classification due to its ability to extract semantic information from complex data. Classification tasks often include predefined label hierarchies that represent the semantic relationships among classes. However, these hierarchies are frequently overlooked, and most approaches focus only on fine-grained classification schemes. In this paper, we present a novel Semantics-Aware Hierarchical Consensus (SAHC) approach to learn hierarchical features and relationships by integrating hierarchy-specific classification heads within a deep network architecture, each specialized in different degrees of class granularity. The proposed approach employs trainable hierarchy matrices, which guide the network through the learning of the hierarchical structure in a self-consistent manner. Furthermore, we introduce a hierarchical consensus mechanism to ensure aligned probability distributions across different hierarchical levels. This mechanism acts as a weighted ensemble being able to effectively leverage the inherent structure of the hierarchical classification task. The proposed SAHC method is evaluated on two benchmark datasets with different degrees of hierarchical complexity on different tasks, considering varying spectral and spatial resolutions. Experimental results show both the effectiveness of the proposed approach in guiding network learning and the robustness of the hierarchical consensus for remote sensing image classification tasks. The codes will be released at https://github.com/rslab-unitrento/sahc.
format Preprint
id arxiv_https___arxiv_org_abs_2510_04916
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Hierarchical Self-Consistent Regularization Approach to Satellite Image Time Series Classification
Weikmann, Giulio
Perantoni, Gianmarco
Bruzzone, Lorenzo
Computer Vision and Pattern Recognition
I.4.6; I.4.8; I.4.10
Deep learning has become increasingly important in remote sensing image classification due to its ability to extract semantic information from complex data. Classification tasks often include predefined label hierarchies that represent the semantic relationships among classes. However, these hierarchies are frequently overlooked, and most approaches focus only on fine-grained classification schemes. In this paper, we present a novel Semantics-Aware Hierarchical Consensus (SAHC) approach to learn hierarchical features and relationships by integrating hierarchy-specific classification heads within a deep network architecture, each specialized in different degrees of class granularity. The proposed approach employs trainable hierarchy matrices, which guide the network through the learning of the hierarchical structure in a self-consistent manner. Furthermore, we introduce a hierarchical consensus mechanism to ensure aligned probability distributions across different hierarchical levels. This mechanism acts as a weighted ensemble being able to effectively leverage the inherent structure of the hierarchical classification task. The proposed SAHC method is evaluated on two benchmark datasets with different degrees of hierarchical complexity on different tasks, considering varying spectral and spatial resolutions. Experimental results show both the effectiveness of the proposed approach in guiding network learning and the robustness of the hierarchical consensus for remote sensing image classification tasks. The codes will be released at https://github.com/rslab-unitrento/sahc.
title A Hierarchical Self-Consistent Regularization Approach to Satellite Image Time Series Classification
topic Computer Vision and Pattern Recognition
I.4.6; I.4.8; I.4.10
url https://arxiv.org/abs/2510.04916