AimTS: Augmented Series and Image Contrastive Learning for Time Series Classification

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Chen, Yuxuan, Huang, Shanshan, Cheng, Yunyao, Chen, Peng, Rao, Zhongwen, Shu, Yang, Yang, Bin, Pan, Lujia, Guo, Chenjuan
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913792210763776
author Chen, Yuxuan
Huang, Shanshan
Cheng, Yunyao
Chen, Peng
Rao, Zhongwen
Shu, Yang
Yang, Bin
Pan, Lujia
Guo, Chenjuan
author_facet Chen, Yuxuan
Huang, Shanshan
Cheng, Yunyao
Chen, Peng
Rao, Zhongwen
Shu, Yang
Yang, Bin
Pan, Lujia
Guo, Chenjuan
contents Time series classification (TSC) is an important task in time series analysis. Existing TSC methods mainly train on each single domain separately, suffering from a degradation in accuracy when the samples for training are insufficient in certain domains. The pre-training and fine-tuning paradigm provides a promising direction for solving this problem. However, time series from different domains are substantially divergent, which challenges the effective pre-training on multi-source data and the generalization ability of pre-trained models. To handle this issue, we introduce Augmented Series and Image Contrastive Learning for Time Series Classification (AimTS), a pre-training framework that learns generalizable representations from multi-source time series data. We propose a two-level prototype-based contrastive learning method to effectively utilize various augmentations in multi-source pre-training, which learns representations for TSC that can be generalized to different domains. In addition, considering augmentations within the single time series modality are insufficient to fully address classification problems with distribution shift, we introduce the image modality to supplement structural information and establish a series-image contrastive learning to improve the generalization of the learned representations for TSC tasks. Extensive experiments show that after multi-source pre-training, AimTS achieves good generalization performance, enabling efficient learning and even few-shot learning on various downstream TSC datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2504_09993
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AimTS: Augmented Series and Image Contrastive Learning for Time Series Classification
Chen, Yuxuan
Huang, Shanshan
Cheng, Yunyao
Chen, Peng
Rao, Zhongwen
Shu, Yang
Yang, Bin
Pan, Lujia
Guo, Chenjuan
Machine Learning
Time series classification (TSC) is an important task in time series analysis. Existing TSC methods mainly train on each single domain separately, suffering from a degradation in accuracy when the samples for training are insufficient in certain domains. The pre-training and fine-tuning paradigm provides a promising direction for solving this problem. However, time series from different domains are substantially divergent, which challenges the effective pre-training on multi-source data and the generalization ability of pre-trained models. To handle this issue, we introduce Augmented Series and Image Contrastive Learning for Time Series Classification (AimTS), a pre-training framework that learns generalizable representations from multi-source time series data. We propose a two-level prototype-based contrastive learning method to effectively utilize various augmentations in multi-source pre-training, which learns representations for TSC that can be generalized to different domains. In addition, considering augmentations within the single time series modality are insufficient to fully address classification problems with distribution shift, we introduce the image modality to supplement structural information and establish a series-image contrastive learning to improve the generalization of the learned representations for TSC tasks. Extensive experiments show that after multi-source pre-training, AimTS achieves good generalization performance, enabling efficient learning and even few-shot learning on various downstream TSC datasets.
title AimTS: Augmented Series and Image Contrastive Learning for Time Series Classification
topic Machine Learning
url https://arxiv.org/abs/2504.09993