ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecasting
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866913930171908096 |
|---|---|
| author | Ruan, Weilin Chen, Wei Dang, Xilin Zhou, Jianxiang Li, Weichuang Liu, Xu Liang, Yuxuan |
| author_facet | Ruan, Weilin Chen, Wei Dang, Xilin Zhou, Jianxiang Li, Weichuang Liu, Xu Liang, Yuxuan |
| contents | Spatio-temporal forecasting is essential for understanding future dynamics within real-world systems by leveraging historical data from multiple locations. Existing methods often prioritize the development of intricate neural networks to capture the complex dependencies of the data. These methods neglect node-level heterogeneity and face over-parameterization when attempting to model node-specific characteristics. In this paper, we present a novel low-rank adaptation framework for existing spatio-temporal prediction models, termed \model, which alleviates the aforementioned problems through node-level adjustments. Specifically, we introduce the node-adaptive low-rank layer and node-specific predictor, capturing the complex functional characteristics of nodes while maintaining computational efficiency. Extensive experiments on multiple real-world datasets demonstrate that our method consistently achieves superior performance across various forecasting models with minimal computational overhead, improving performance by 7% with only 1% additional parameter cost. The source code is available at https://github.com/RWLinno/ST-LoRA. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_07919 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecasting Ruan, Weilin Chen, Wei Dang, Xilin Zhou, Jianxiang Li, Weichuang Liu, Xu Liang, Yuxuan Machine Learning Artificial Intelligence Spatio-temporal forecasting is essential for understanding future dynamics within real-world systems by leveraging historical data from multiple locations. Existing methods often prioritize the development of intricate neural networks to capture the complex dependencies of the data. These methods neglect node-level heterogeneity and face over-parameterization when attempting to model node-specific characteristics. In this paper, we present a novel low-rank adaptation framework for existing spatio-temporal prediction models, termed \model, which alleviates the aforementioned problems through node-level adjustments. Specifically, we introduce the node-adaptive low-rank layer and node-specific predictor, capturing the complex functional characteristics of nodes while maintaining computational efficiency. Extensive experiments on multiple real-world datasets demonstrate that our method consistently achieves superior performance across various forecasting models with minimal computational overhead, improving performance by 7% with only 1% additional parameter cost. The source code is available at https://github.com/RWLinno/ST-LoRA. |
| title | ST-LoRA: Low-rank Adaptation for Spatio-Temporal Forecasting |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2404.07919 |