Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ye, Jiexia, Yu, Yongzi, Zhang, Weiqi, Wang, Le, Li, Jia, Tsung, Fugee
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915498260692992
author Ye, Jiexia
Yu, Yongzi
Zhang, Weiqi
Wang, Le
Li, Jia
Tsung, Fugee
author_facet Ye, Jiexia
Yu, Yongzi
Zhang, Weiqi
Wang, Le
Li, Jia
Tsung, Fugee
contents Time series data are ubiquitous across diverse real-world applications, making time series analysis critically important. Traditional approaches are largely task-specific, offering limited functionality and poor transferability. In recent years, foundation models have revolutionized NLP and CV with their remarkable cross-task transferability, zero-/few-shot learning capabilities, and multimodal integration capacity. This success has motivated increasing efforts to explore foundation models for addressing time series modeling challenges. Although some tutorials and surveys were published in the early stages of this field, the rapid pace of recent developments necessitates a more comprehensive and in-depth synthesis to cover the latest advances. Our survey aims to fill this gap by introducing a modality-aware, challenge-oriented perspective, which reveals how foundation models pre-trained on different modalities face distinct hurdles when adapted to time series tasks. Building on this perspective, we propose a taxonomy of existing works organized by pre-training modality (time series, language, and vision), analyze modality-specific challenges and categorize corresponding solutions, discussing their advantages and limitations. Beyond this, we review real-world applications to illustrate domain-specific advancements, provide open-source codes, and conclude with potential future research directions in this rapidly evolving field.
format Preprint
id arxiv_https___arxiv_org_abs_2405_02358
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey
Ye, Jiexia
Yu, Yongzi
Zhang, Weiqi
Wang, Le
Li, Jia
Tsung, Fugee
Machine Learning
Artificial Intelligence
Time series data are ubiquitous across diverse real-world applications, making time series analysis critically important. Traditional approaches are largely task-specific, offering limited functionality and poor transferability. In recent years, foundation models have revolutionized NLP and CV with their remarkable cross-task transferability, zero-/few-shot learning capabilities, and multimodal integration capacity. This success has motivated increasing efforts to explore foundation models for addressing time series modeling challenges. Although some tutorials and surveys were published in the early stages of this field, the rapid pace of recent developments necessitates a more comprehensive and in-depth synthesis to cover the latest advances. Our survey aims to fill this gap by introducing a modality-aware, challenge-oriented perspective, which reveals how foundation models pre-trained on different modalities face distinct hurdles when adapted to time series tasks. Building on this perspective, we propose a taxonomy of existing works organized by pre-training modality (time series, language, and vision), analyze modality-specific challenges and categorize corresponding solutions, discussing their advantages and limitations. Beyond this, we review real-world applications to illustrate domain-specific advancements, provide open-source codes, and conclude with potential future research directions in this rapidly evolving field.
title Empowering Time Series Analysis with Foundation Models: A Comprehensive Survey
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2405.02358