ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916525332496384 |
|---|---|
| author | Wang, Chengsen Qi, Qi Wang, Jingyu Sun, Haifeng Zhuang, Zirui Wu, Jinming Zhang, Lei Liao, Jianxin |
| author_facet | Wang, Chengsen Qi, Qi Wang, Jingyu Sun, Haifeng Zhuang, Zirui Wu, Jinming Zhang, Lei Liao, Jianxin |
| contents | Human experts typically integrate numerical and textual multimodal information to analyze time series. However, most traditional deep learning predictors rely solely on unimodal numerical data, using a fixed-length window for training and prediction on a single dataset, and cannot adapt to different scenarios. The powered pre-trained large language model has introduced new opportunities for time series analysis. Yet, existing methods are either inefficient in training, incapable of handling textual information, or lack zero-shot forecasting capability. In this paper, we innovatively model time series as a foreign language and construct ChatTime, a unified framework for time series and text processing. As an out-of-the-box multimodal time series foundation model, ChatTime provides zero-shot forecasting capability and supports bimodal input/output for both time series and text. We design a series of experiments to verify the superior performance of ChatTime across multiple tasks and scenarios, and create four multimodal datasets to address data gaps. The experimental results demonstrate the potential and utility of ChatTime. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_11376 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data Wang, Chengsen Qi, Qi Wang, Jingyu Sun, Haifeng Zhuang, Zirui Wu, Jinming Zhang, Lei Liao, Jianxin Computation and Language Machine Learning Human experts typically integrate numerical and textual multimodal information to analyze time series. However, most traditional deep learning predictors rely solely on unimodal numerical data, using a fixed-length window for training and prediction on a single dataset, and cannot adapt to different scenarios. The powered pre-trained large language model has introduced new opportunities for time series analysis. Yet, existing methods are either inefficient in training, incapable of handling textual information, or lack zero-shot forecasting capability. In this paper, we innovatively model time series as a foreign language and construct ChatTime, a unified framework for time series and text processing. As an out-of-the-box multimodal time series foundation model, ChatTime provides zero-shot forecasting capability and supports bimodal input/output for both time series and text. We design a series of experiments to verify the superior performance of ChatTime across multiple tasks and scenarios, and create four multimodal datasets to address data gaps. The experimental results demonstrate the potential and utility of ChatTime. |
| title | ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data |
| topic | Computation and Language Machine Learning |
| url | https://arxiv.org/abs/2412.11376 |