MSTAR: Multi-Scale Backbone Architecture Search for Timeseries Classification

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Cao, Tue M., Tran, Nhat H., Pham, Hieu H., Nguyen, Hung T., Nguyen, Le P.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929250929475584
author Cao, Tue M.
Tran, Nhat H.
Pham, Hieu H.
Nguyen, Hung T.
Nguyen, Le P.
author_facet Cao, Tue M.
Tran, Nhat H.
Pham, Hieu H.
Nguyen, Hung T.
Nguyen, Le P.
contents Most of the previous approaches to Time Series Classification (TSC) highlight the significance of receptive fields and frequencies while overlooking the time resolution. Hence, unavoidably suffered from scalability issues as they integrated an extensive range of receptive fields into classification models. Other methods, while having a better adaptation for large datasets, require manual design and yet not being able to reach the optimal architecture due to the uniqueness of each dataset. We overcome these challenges by proposing a novel multi-scale search space and a framework for Neural architecture search (NAS), which addresses both the problem of frequency and time resolution, discovering the suitable scale for a specific dataset. We further show that our model can serve as a backbone to employ a powerful Transformer module with both untrained and pre-trained weights. Our search space reaches the state-of-the-art performance on four datasets on four different domains while introducing more than ten highly fine-tuned models for each data.
format Preprint
id arxiv_https___arxiv_org_abs_2402_13822
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle MSTAR: Multi-Scale Backbone Architecture Search for Timeseries Classification
Cao, Tue M.
Tran, Nhat H.
Pham, Hieu H.
Nguyen, Hung T.
Nguyen, Le P.
Computer Vision and Pattern Recognition
Most of the previous approaches to Time Series Classification (TSC) highlight the significance of receptive fields and frequencies while overlooking the time resolution. Hence, unavoidably suffered from scalability issues as they integrated an extensive range of receptive fields into classification models. Other methods, while having a better adaptation for large datasets, require manual design and yet not being able to reach the optimal architecture due to the uniqueness of each dataset. We overcome these challenges by proposing a novel multi-scale search space and a framework for Neural architecture search (NAS), which addresses both the problem of frequency and time resolution, discovering the suitable scale for a specific dataset. We further show that our model can serve as a backbone to employ a powerful Transformer module with both untrained and pre-trained weights. Our search space reaches the state-of-the-art performance on four datasets on four different domains while introducing more than ten highly fine-tuned models for each data.
title MSTAR: Multi-Scale Backbone Architecture Search for Timeseries Classification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.13822