Addressing Prediction Delays in Time Series Forecasting: A Continuous GRU Approach with Derivative Regularization

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jhin, Sheo Yon, Kim, Seojin, Park, Noseong
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916308838252544
author Jhin, Sheo Yon
Kim, Seojin
Park, Noseong
author_facet Jhin, Sheo Yon
Kim, Seojin
Park, Noseong
contents Time series forecasting has been an essential field in many different application areas, including economic analysis, meteorology, and so forth. The majority of time series forecasting models are trained using the mean squared error (MSE). However, this training based on MSE causes a limitation known as prediction delay. The prediction delay, which implies the ground-truth precedes the prediction, can cause serious problems in a variety of fields, e.g., finance and weather forecasting -- as a matter of fact, predictions succeeding ground-truth observations are not practically meaningful although their MSEs can be low. This paper proposes a new perspective on traditional time series forecasting tasks and introduces a new solution to mitigate the prediction delay. We introduce a continuous-time gated recurrent unit (GRU) based on the neural ordinary differential equation (NODE) which can supervise explicit time-derivatives. We generalize the GRU architecture in a continuous-time manner and minimize the prediction delay through our time-derivative regularization. Our method outperforms in metrics such as MSE, Dynamic Time Warping (DTW) and Time Distortion Index (TDI). In addition, we demonstrate the low prediction delay of our method in a variety of datasets.
format Preprint
id arxiv_https___arxiv_org_abs_2407_01622
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Addressing Prediction Delays in Time Series Forecasting: A Continuous GRU Approach with Derivative Regularization
Jhin, Sheo Yon
Kim, Seojin
Park, Noseong
Machine Learning
Time series forecasting has been an essential field in many different application areas, including economic analysis, meteorology, and so forth. The majority of time series forecasting models are trained using the mean squared error (MSE). However, this training based on MSE causes a limitation known as prediction delay. The prediction delay, which implies the ground-truth precedes the prediction, can cause serious problems in a variety of fields, e.g., finance and weather forecasting -- as a matter of fact, predictions succeeding ground-truth observations are not practically meaningful although their MSEs can be low. This paper proposes a new perspective on traditional time series forecasting tasks and introduces a new solution to mitigate the prediction delay. We introduce a continuous-time gated recurrent unit (GRU) based on the neural ordinary differential equation (NODE) which can supervise explicit time-derivatives. We generalize the GRU architecture in a continuous-time manner and minimize the prediction delay through our time-derivative regularization. Our method outperforms in metrics such as MSE, Dynamic Time Warping (DTW) and Time Distortion Index (TDI). In addition, we demonstrate the low prediction delay of our method in a variety of datasets.
title Addressing Prediction Delays in Time Series Forecasting: A Continuous GRU Approach with Derivative Regularization
topic Machine Learning
url https://arxiv.org/abs/2407.01622