Saved in:
Bibliographic Details
Main Authors: Dempster, Angus, Foumani, Navid Mohammadi, Tan, Chang Wei, Miller, Lynn, Mishra, Amish, Salehi, Mahsa, Pelletier, Charlotte, Schmidt, Daniel F., Webb, Geoffrey I.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2502.15122
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916624266690560
author Dempster, Angus
Foumani, Navid Mohammadi
Tan, Chang Wei
Miller, Lynn
Mishra, Amish
Salehi, Mahsa
Pelletier, Charlotte
Schmidt, Daniel F.
Webb, Geoffrey I.
author_facet Dempster, Angus
Foumani, Navid Mohammadi
Tan, Chang Wei
Miller, Lynn
Mishra, Amish
Salehi, Mahsa
Pelletier, Charlotte
Schmidt, Daniel F.
Webb, Geoffrey I.
contents We introduce MONSTER-the MONash Scalable Time Series Evaluation Repository-a collection of large datasets for time series classification. The field of time series classification has benefitted from common benchmarks set by the UCR and UEA time series classification repositories. However, the datasets in these benchmarks are small, with median sizes of 217 and 255 examples, respectively. In consequence they favour a narrow subspace of models that are optimised to achieve low classification error on a wide variety of smaller datasets, that is, models that minimise variance, and give little weight to computational issues such as scalability. Our hope is to diversify the field by introducing benchmarks using larger datasets. We believe that there is enormous potential for new progress in the field by engaging with the theoretical and practical challenges of learning effectively from larger quantities of data.
format Preprint
id arxiv_https___arxiv_org_abs_2502_15122
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MONSTER: Monash Scalable Time Series Evaluation Repository
Dempster, Angus
Foumani, Navid Mohammadi
Tan, Chang Wei
Miller, Lynn
Mishra, Amish
Salehi, Mahsa
Pelletier, Charlotte
Schmidt, Daniel F.
Webb, Geoffrey I.
Machine Learning
We introduce MONSTER-the MONash Scalable Time Series Evaluation Repository-a collection of large datasets for time series classification. The field of time series classification has benefitted from common benchmarks set by the UCR and UEA time series classification repositories. However, the datasets in these benchmarks are small, with median sizes of 217 and 255 examples, respectively. In consequence they favour a narrow subspace of models that are optimised to achieve low classification error on a wide variety of smaller datasets, that is, models that minimise variance, and give little weight to computational issues such as scalability. Our hope is to diversify the field by introducing benchmarks using larger datasets. We believe that there is enormous potential for new progress in the field by engaging with the theoretical and practical challenges of learning effectively from larger quantities of data.
title MONSTER: Monash Scalable Time Series Evaluation Repository
topic Machine Learning
url https://arxiv.org/abs/2502.15122