Dynamic mapping from static labels: remote sensing dynamic sample generation with temporal-spectral embedding

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yuan, Shuai, Chen, Shuang, Lin, Tianwu, Yuan, Jincheng, Tian, Geng, Xu, Yang, Wang, Jie, Gong, Peng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911073642217472
author Yuan, Shuai
Chen, Shuang
Lin, Tianwu
Yuan, Jincheng
Tian, Geng
Xu, Yang
Wang, Jie
Gong, Peng
author_facet Yuan, Shuai
Chen, Shuang
Lin, Tianwu
Yuan, Jincheng
Tian, Geng
Xu, Yang
Wang, Jie
Gong, Peng
contents Accurate remote sensing geographic mapping requires timely and representative samples. However, rapid land surface changes often render static samples obsolete within months, making manual sample updates labor-intensive and unsustainable. To address this challenge, we propose TasGen, a two-stage Temporal spectral-aware Automatic Sample Generation method for generating dynamic training samples from single-date static labels without human intervention. Land surface dynamics often manifest as anomalies in temporal-spectral sequences. %These anomalies are multivariate yet unified: temporal, spectral, or joint anomalies stem from different mechanisms and cannot be naively coupled, as this may obscure the nature of changes. Yet, any land surface state corresponds to a coherent temporal-spectral signature, which would be lost if the two dimensions are modeled separately. To effectively capture these dynamics, TasGen first disentangles temporal and spectral features to isolate their individual contributions, and then couples them to model their synergistic interactions. In the first stage, we introduce a hierarchical temporal-spectral variational autoencoder (HTS-VAE) with a dual-dimension embedding to learn low-dimensional latent patterns of normal samples by first disentangling and then jointly embedding temporal and spectral information. This temporal-spectral embedding enables robust anomaly detection by identifying deviations from learned joint patterns. In the second stage, a classifier trained on stable samples relabels change points across time to generate dynamic samples. To not only detect but also explain surface dynamics, we further propose an anomaly interpretation method based on Gibbs sampling, which attributes changes to specific spectral-temporal dimensions.
format Preprint
id arxiv_https___arxiv_org_abs_2506_02574
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dynamic mapping from static labels: remote sensing dynamic sample generation with temporal-spectral embedding
Yuan, Shuai
Chen, Shuang
Lin, Tianwu
Yuan, Jincheng
Tian, Geng
Xu, Yang
Wang, Jie
Gong, Peng
Image and Video Processing
Computer Vision and Pattern Recognition
Multimedia
Accurate remote sensing geographic mapping requires timely and representative samples. However, rapid land surface changes often render static samples obsolete within months, making manual sample updates labor-intensive and unsustainable. To address this challenge, we propose TasGen, a two-stage Temporal spectral-aware Automatic Sample Generation method for generating dynamic training samples from single-date static labels without human intervention. Land surface dynamics often manifest as anomalies in temporal-spectral sequences. %These anomalies are multivariate yet unified: temporal, spectral, or joint anomalies stem from different mechanisms and cannot be naively coupled, as this may obscure the nature of changes. Yet, any land surface state corresponds to a coherent temporal-spectral signature, which would be lost if the two dimensions are modeled separately. To effectively capture these dynamics, TasGen first disentangles temporal and spectral features to isolate their individual contributions, and then couples them to model their synergistic interactions. In the first stage, we introduce a hierarchical temporal-spectral variational autoencoder (HTS-VAE) with a dual-dimension embedding to learn low-dimensional latent patterns of normal samples by first disentangling and then jointly embedding temporal and spectral information. This temporal-spectral embedding enables robust anomaly detection by identifying deviations from learned joint patterns. In the second stage, a classifier trained on stable samples relabels change points across time to generate dynamic samples. To not only detect but also explain surface dynamics, we further propose an anomaly interpretation method based on Gibbs sampling, which attributes changes to specific spectral-temporal dimensions.
title Dynamic mapping from static labels: remote sensing dynamic sample generation with temporal-spectral embedding
topic Image and Video Processing
Computer Vision and Pattern Recognition
Multimedia
url https://arxiv.org/abs/2506.02574