There is No "apple" in Timeseries: Rethinking TSFM through the Lens of Invariance

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Prabowo, Arian, Salim, Flora D.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915571535183872
author Prabowo, Arian
Salim, Flora D.
author_facet Prabowo, Arian
Salim, Flora D.
contents Timeseries foundation models (TSFMs) have multiplied, yet lightweight supervised baselines and even classical models often match them. We argue this gap stems from the naive importation of NLP or CV pipelines. In language and vision, large web-scale corpora densely capture human concepts i.e. there are countless images and text of apples. In contrast, timeseries data is built to complement the image and text modalities. There are no timeseries dataset that contains the concept apple. As a result, the scrape-everything-online paradigm fails for TS. We posit that progress demands a shift from opportunistic aggregation to principled design: constructing datasets that systematically span the space of invariance that preserve temporal semantics. To this end, we suggest that the ontology of timeseries invariances should be built based on first principles. Only by ensuring representational completeness through invariance coverage can TSFMs achieve the aligned structure necessary for generalisation, reasoning, and truly emergent behaviour.
format Preprint
id arxiv_https___arxiv_org_abs_2510_20119
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle There is No "apple" in Timeseries: Rethinking TSFM through the Lens of Invariance
Prabowo, Arian
Salim, Flora D.
Machine Learning
Timeseries foundation models (TSFMs) have multiplied, yet lightweight supervised baselines and even classical models often match them. We argue this gap stems from the naive importation of NLP or CV pipelines. In language and vision, large web-scale corpora densely capture human concepts i.e. there are countless images and text of apples. In contrast, timeseries data is built to complement the image and text modalities. There are no timeseries dataset that contains the concept apple. As a result, the scrape-everything-online paradigm fails for TS. We posit that progress demands a shift from opportunistic aggregation to principled design: constructing datasets that systematically span the space of invariance that preserve temporal semantics. To this end, we suggest that the ontology of timeseries invariances should be built based on first principles. Only by ensuring representational completeness through invariance coverage can TSFMs achieve the aligned structure necessary for generalisation, reasoning, and truly emergent behaviour.
title There is No "apple" in Timeseries: Rethinking TSFM through the Lens of Invariance
topic Machine Learning
url https://arxiv.org/abs/2510.20119