Elucidating the Design Choice of Probability Paths in Flow Matching for Forecasting
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915447753932800 |
|---|---|
| author | Lim, Soon Hoe Wang, Yijin Yu, Annan Hart, Emma Mahoney, Michael W. Li, Xiaoye S. Erichson, N. Benjamin |
| author_facet | Lim, Soon Hoe Wang, Yijin Yu, Annan Hart, Emma Mahoney, Michael W. Li, Xiaoye S. Erichson, N. Benjamin |
| contents | Flow matching has recently emerged as a powerful paradigm for generative modeling and has been extended to probabilistic time series forecasting in latent spaces. However, the impact of the specific choice of probability path model on forecasting performance remains under-explored. In this work, we demonstrate that forecasting spatio-temporal data with flow matching is highly sensitive to the selection of the probability path model. Motivated by this insight, we propose a novel probability path model designed to improve forecasting performance. Our empirical results across various dynamical system benchmarks show that our model achieves faster convergence during training and improved predictive performance compared to existing probability path models. Importantly, our approach is efficient during inference, requiring only a few sampling steps. This makes our proposed model practical for real-world applications and opens new avenues for probabilistic forecasting. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_03229 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Elucidating the Design Choice of Probability Paths in Flow Matching for Forecasting Lim, Soon Hoe Wang, Yijin Yu, Annan Hart, Emma Mahoney, Michael W. Li, Xiaoye S. Erichson, N. Benjamin Machine Learning Flow matching has recently emerged as a powerful paradigm for generative modeling and has been extended to probabilistic time series forecasting in latent spaces. However, the impact of the specific choice of probability path model on forecasting performance remains under-explored. In this work, we demonstrate that forecasting spatio-temporal data with flow matching is highly sensitive to the selection of the probability path model. Motivated by this insight, we propose a novel probability path model designed to improve forecasting performance. Our empirical results across various dynamical system benchmarks show that our model achieves faster convergence during training and improved predictive performance compared to existing probability path models. Importantly, our approach is efficient during inference, requiring only a few sampling steps. This makes our proposed model practical for real-world applications and opens new avenues for probabilistic forecasting. |
| title | Elucidating the Design Choice of Probability Paths in Flow Matching for Forecasting |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2410.03229 |