Dynamic Long-Term Time-Series Forecasting via Meta Transformer Networks
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929223652868096 |
|---|---|
| author | Ma'sum, Muhammad Anwar Sarkar, MD Rasel Pratama, Mahardhika Ramasamy, Savitha Anavatti, Sreenatha Liu, Lin Habibullah Kowalczyk, Ryszard |
| author_facet | Ma'sum, Muhammad Anwar Sarkar, MD Rasel Pratama, Mahardhika Ramasamy, Savitha Anavatti, Sreenatha Liu, Lin Habibullah Kowalczyk, Ryszard |
| contents | A reliable long-term time-series forecaster is highly demanded in practice but comes across many challenges such as low computational and memory footprints as well as robustness against dynamic learning environments. This paper proposes Meta-Transformer Networks (MANTRA) to deal with the dynamic long-term time-series forecasting tasks. MANTRA relies on the concept of fast and slow learners where a collection of fast learners learns different aspects of data distributions while adapting quickly to changes. A slow learner tailors suitable representations to fast learners. Fast adaptations to dynamic environments are achieved using the universal representation transformer layers producing task-adapted representations with a small number of parameters. Our experiments using four datasets with different prediction lengths demonstrate the advantage of our approach with at least $3\%$ improvements over the baseline algorithms for both multivariate and univariate settings. Source codes of MANTRA are publicly available in \url{https://github.com/anwarmaxsum/MANTRA}. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_13968 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Dynamic Long-Term Time-Series Forecasting via Meta Transformer Networks Ma'sum, Muhammad Anwar Sarkar, MD Rasel Pratama, Mahardhika Ramasamy, Savitha Anavatti, Sreenatha Liu, Lin Habibullah Kowalczyk, Ryszard Machine Learning Artificial Intelligence A reliable long-term time-series forecaster is highly demanded in practice but comes across many challenges such as low computational and memory footprints as well as robustness against dynamic learning environments. This paper proposes Meta-Transformer Networks (MANTRA) to deal with the dynamic long-term time-series forecasting tasks. MANTRA relies on the concept of fast and slow learners where a collection of fast learners learns different aspects of data distributions while adapting quickly to changes. A slow learner tailors suitable representations to fast learners. Fast adaptations to dynamic environments are achieved using the universal representation transformer layers producing task-adapted representations with a small number of parameters. Our experiments using four datasets with different prediction lengths demonstrate the advantage of our approach with at least $3\%$ improvements over the baseline algorithms for both multivariate and univariate settings. Source codes of MANTRA are publicly available in \url{https://github.com/anwarmaxsum/MANTRA}. |
| title | Dynamic Long-Term Time-Series Forecasting via Meta Transformer Networks |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2401.13968 |