Spatial-Temporal-Spectral Mamba with Sparse Deformable Token Sequence for Enhanced MODIS Time Series Classification

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Dewis, Zack, Xu, Zhengsen, Zhu, Yimin, Alkayid, Motasem, Heffring, Mabel, Xu, Lincoln Linlin
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866908478656741376
author Dewis, Zack
Xu, Zhengsen
Zhu, Yimin
Alkayid, Motasem
Heffring, Mabel
Xu, Lincoln Linlin
author_facet Dewis, Zack
Xu, Zhengsen
Zhu, Yimin
Alkayid, Motasem
Heffring, Mabel
Xu, Lincoln Linlin
contents Although MODIS time series data are critical for supporting dynamic, large-scale land cover land use classification, it is a challenging task to capture the subtle class signature information due to key MODIS difficulties, e.g., high temporal dimensionality, mixed pixels, and spatial-temporal-spectral coupling effect. This paper presents a novel spatial-temporal-spectral Mamba (STSMamba) with deformable token sequence for enhanced MODIS time series classification, with the following key contributions. First, to disentangle temporal-spectral feature coupling, a temporal grouped stem (TGS) module is designed for initial feature learning. Second, to improve Mamba modeling efficiency and accuracy, a sparse, deformable Mamba sequencing (SDMS) approach is designed, which can reduce the potential information redundancy in Mamba sequence and improve the adaptability and learnability of the Mamba sequencing. Third, based on SDMS, to improve feature learning, a novel spatial-temporal-spectral Mamba architecture is designed, leading to three modules, i.e., a sparse deformable spatial Mamba module (SDSpaM), a sparse deformable spectral Mamba module (SDSpeM), and a sparse deformable temporal Mamba module (SDTM) to explicitly learn key information sources in MODIS. The proposed approach is tested on MODIS time series data in comparison with many state-of-the-art approaches, and the results demonstrate that the proposed approach can achieve higher classification accuracy with reduced computational complexity.
format Preprint
id arxiv_https___arxiv_org_abs_2508_02839
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Spatial-Temporal-Spectral Mamba with Sparse Deformable Token Sequence for Enhanced MODIS Time Series Classification
Dewis, Zack
Xu, Zhengsen
Zhu, Yimin
Alkayid, Motasem
Heffring, Mabel
Xu, Lincoln Linlin
Image and Video Processing
Signal Processing
Although MODIS time series data are critical for supporting dynamic, large-scale land cover land use classification, it is a challenging task to capture the subtle class signature information due to key MODIS difficulties, e.g., high temporal dimensionality, mixed pixels, and spatial-temporal-spectral coupling effect. This paper presents a novel spatial-temporal-spectral Mamba (STSMamba) with deformable token sequence for enhanced MODIS time series classification, with the following key contributions. First, to disentangle temporal-spectral feature coupling, a temporal grouped stem (TGS) module is designed for initial feature learning. Second, to improve Mamba modeling efficiency and accuracy, a sparse, deformable Mamba sequencing (SDMS) approach is designed, which can reduce the potential information redundancy in Mamba sequence and improve the adaptability and learnability of the Mamba sequencing. Third, based on SDMS, to improve feature learning, a novel spatial-temporal-spectral Mamba architecture is designed, leading to three modules, i.e., a sparse deformable spatial Mamba module (SDSpaM), a sparse deformable spectral Mamba module (SDSpeM), and a sparse deformable temporal Mamba module (SDTM) to explicitly learn key information sources in MODIS. The proposed approach is tested on MODIS time series data in comparison with many state-of-the-art approaches, and the results demonstrate that the proposed approach can achieve higher classification accuracy with reduced computational complexity.
title Spatial-Temporal-Spectral Mamba with Sparse Deformable Token Sequence for Enhanced MODIS Time Series Classification
topic Image and Video Processing
Signal Processing
url https://arxiv.org/abs/2508.02839