tsdataleaks: An R Package to Detect Potential Data Leaks in Forecasting Competitions

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autore principale: Talagala, Thiyanga S.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913235722043392
author Talagala, Thiyanga S.
author_facet Talagala, Thiyanga S.
contents Forecasting competitions are of increasing importance as a means to learn best practices and gain knowledge. Data leakage is one of the most common issues that can often be found in competitions. Data leaks can happen when the training data contains information about the test data. There are a variety of different ways that data leaks can occur with time series data. For example: i) randomly chosen blocks of time series are concatenated to form a new time series; ii) scale-shifts; iii) repeating patterns in time series; iv) white noise is added to the original time series to form a new time series, etc. This work introduces a novel tool to detect these data leaks. The tsdataleaks package provides a simple and computationally efficient algorithm to exploit data leaks in time series data. This paper demonstrates the package design and its power to detect data leakages with an application to forecasting competition data.
format Preprint
id arxiv_https___arxiv_org_abs_2402_10522
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle tsdataleaks: An R Package to Detect Potential Data Leaks in Forecasting Competitions
Talagala, Thiyanga S.
Applications
Forecasting competitions are of increasing importance as a means to learn best practices and gain knowledge. Data leakage is one of the most common issues that can often be found in competitions. Data leaks can happen when the training data contains information about the test data. There are a variety of different ways that data leaks can occur with time series data. For example: i) randomly chosen blocks of time series are concatenated to form a new time series; ii) scale-shifts; iii) repeating patterns in time series; iv) white noise is added to the original time series to form a new time series, etc. This work introduces a novel tool to detect these data leaks. The tsdataleaks package provides a simple and computationally efficient algorithm to exploit data leaks in time series data. This paper demonstrates the package design and its power to detect data leakages with an application to forecasting competition data.
title tsdataleaks: An R Package to Detect Potential Data Leaks in Forecasting Competitions
topic Applications
url https://arxiv.org/abs/2402.10522