How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlook
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914070988324864 |
|---|---|
| author | Liu, Haoxin Kamarthi, Harshavardhan Zhao, Zhiyuan Xu, Shangqing Wang, Shiyu Wen, Qingsong Hartvigsen, Tom Wang, Fei Prakash, B. Aditya |
| author_facet | Liu, Haoxin Kamarthi, Harshavardhan Zhao, Zhiyuan Xu, Shangqing Wang, Shiyu Wen, Qingsong Hartvigsen, Tom Wang, Fei Prakash, B. Aditya |
| contents | Time series analysis (TSA) is a longstanding research topic in the data mining community and has wide real-world significance. Compared to "richer" modalities such as language and vision, which have recently experienced explosive development and are densely connected, the time-series modality remains relatively underexplored and isolated. We notice that many recent TSA works have formed a new research field, i.e., Multiple Modalities for TSA (MM4TSA). In general, these MM4TSA works follow a common motivation: how TSA can benefit from multiple modalities. This survey is the first to offer a comprehensive review and a detailed outlook for this emerging field. Specifically, we systematically discuss three benefits: (1) reusing foundation models of other modalities for efficient TSA, (2) multimodal extension for enhanced TSA, and (3) cross-modality interaction for advanced TSA. We further group the works by the introduced modality type, including text, images, audio, tables, and others, within each perspective. Finally, we identify the gaps with future opportunities, including the reused modalities selections, heterogeneous modality combinations, and unseen tasks generalizations, corresponding to the three benefits. We release an up-to-date GitHub repository that includes key papers and resources. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_11835 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlook Liu, Haoxin Kamarthi, Harshavardhan Zhao, Zhiyuan Xu, Shangqing Wang, Shiyu Wen, Qingsong Hartvigsen, Tom Wang, Fei Prakash, B. Aditya Machine Learning Computer Vision and Pattern Recognition Time series analysis (TSA) is a longstanding research topic in the data mining community and has wide real-world significance. Compared to "richer" modalities such as language and vision, which have recently experienced explosive development and are densely connected, the time-series modality remains relatively underexplored and isolated. We notice that many recent TSA works have formed a new research field, i.e., Multiple Modalities for TSA (MM4TSA). In general, these MM4TSA works follow a common motivation: how TSA can benefit from multiple modalities. This survey is the first to offer a comprehensive review and a detailed outlook for this emerging field. Specifically, we systematically discuss three benefits: (1) reusing foundation models of other modalities for efficient TSA, (2) multimodal extension for enhanced TSA, and (3) cross-modality interaction for advanced TSA. We further group the works by the introduced modality type, including text, images, audio, tables, and others, within each perspective. Finally, we identify the gaps with future opportunities, including the reused modalities selections, heterogeneous modality combinations, and unseen tasks generalizations, corresponding to the three benefits. We release an up-to-date GitHub repository that includes key papers and resources. |
| title | How Can Time Series Analysis Benefit From Multiple Modalities? A Survey and Outlook |
| topic | Machine Learning Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2503.11835 |