Modular Deep Learning for Multivariate Time-Series: Decoupling Imputation and Downstream Tasks

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Raj, Joseph Arul, Qian, Linglong, Ibrahim, Zina
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915816325251072
author Raj, Joseph Arul
Qian, Linglong
Ibrahim, Zina
author_facet Raj, Joseph Arul
Qian, Linglong
Ibrahim, Zina
contents Missing values are pervasive in large-scale time-series data, posing challenges for reliable analysis and decision-making. Many neural architectures have been designed to model and impute the complex and heterogeneous missingness patterns of such data. Most existing methods are end-to-end, rendering imputation tightly coupled with downstream predictive tasks and leading to limited reusability of the trained model, reduced interpretability, and challenges in assessing model quality. In this paper, we call for a modular approach that decouples imputation and downstream tasks, enabling independent optimisation and greater adaptability. Using the largest open-source Python library for deep learning-based time-series analysis, PyPOTS, we evaluate a modular pipeline across six state-of-the-art models that perform imputation and prediction on seven datasets spanning multiple domains. Our results show that a modular approach maintains high performance while prioritising flexibility and reusability - qualities that are crucial for real-world applications. Through this work, we aim to demonstrate how modularity can benefit multivariate time-series analysis, achieving a balance between performance and adaptability.
format Preprint
id arxiv_https___arxiv_org_abs_2411_03941
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Modular Deep Learning for Multivariate Time-Series: Decoupling Imputation and Downstream Tasks
Raj, Joseph Arul
Qian, Linglong
Ibrahim, Zina
Machine Learning
Artificial Intelligence
Missing values are pervasive in large-scale time-series data, posing challenges for reliable analysis and decision-making. Many neural architectures have been designed to model and impute the complex and heterogeneous missingness patterns of such data. Most existing methods are end-to-end, rendering imputation tightly coupled with downstream predictive tasks and leading to limited reusability of the trained model, reduced interpretability, and challenges in assessing model quality. In this paper, we call for a modular approach that decouples imputation and downstream tasks, enabling independent optimisation and greater adaptability. Using the largest open-source Python library for deep learning-based time-series analysis, PyPOTS, we evaluate a modular pipeline across six state-of-the-art models that perform imputation and prediction on seven datasets spanning multiple domains. Our results show that a modular approach maintains high performance while prioritising flexibility and reusability - qualities that are crucial for real-world applications. Through this work, we aim to demonstrate how modularity can benefit multivariate time-series analysis, achieving a balance between performance and adaptability.
title Modular Deep Learning for Multivariate Time-Series: Decoupling Imputation and Downstream Tasks
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2411.03941