Trajectory Flow Matching with Applications to Clinical Time Series Modeling
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910813111975936 |
|---|---|
| author | Zhang, Xi Pu, Yuan Kawamura, Yuki Loza, Andrew Bengio, Yoshua Shung, Dennis L. Tong, Alexander |
| author_facet | Zhang, Xi Pu, Yuan Kawamura, Yuki Loza, Andrew Bengio, Yoshua Shung, Dennis L. Tong, Alexander |
| contents | Modeling stochastic and irregularly sampled time series is a challenging problem found in a wide range of applications, especially in medicine. Neural stochastic differential equations (Neural SDEs) are an attractive modeling technique for this problem, which parameterize the drift and diffusion terms of an SDE with neural networks. However, current algorithms for training Neural SDEs require backpropagation through the SDE dynamics, greatly limiting their scalability and stability. To address this, we propose Trajectory Flow Matching (TFM), which trains a Neural SDE in a simulation-free manner, bypassing backpropagation through the dynamics. TFM leverages the flow matching technique from generative modeling to model time series. In this work we first establish necessary conditions for TFM to learn time series data. Next, we present a reparameterization trick which improves training stability. Finally, we adapt TFM to the clinical time series setting, demonstrating improved performance on three clinical time series datasets both in terms of absolute performance and uncertainty prediction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_21154 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Trajectory Flow Matching with Applications to Clinical Time Series Modeling Zhang, Xi Pu, Yuan Kawamura, Yuki Loza, Andrew Bengio, Yoshua Shung, Dennis L. Tong, Alexander Machine Learning Artificial Intelligence Modeling stochastic and irregularly sampled time series is a challenging problem found in a wide range of applications, especially in medicine. Neural stochastic differential equations (Neural SDEs) are an attractive modeling technique for this problem, which parameterize the drift and diffusion terms of an SDE with neural networks. However, current algorithms for training Neural SDEs require backpropagation through the SDE dynamics, greatly limiting their scalability and stability. To address this, we propose Trajectory Flow Matching (TFM), which trains a Neural SDE in a simulation-free manner, bypassing backpropagation through the dynamics. TFM leverages the flow matching technique from generative modeling to model time series. In this work we first establish necessary conditions for TFM to learn time series data. Next, we present a reparameterization trick which improves training stability. Finally, we adapt TFM to the clinical time series setting, demonstrating improved performance on three clinical time series datasets both in terms of absolute performance and uncertainty prediction. |
| title | Trajectory Flow Matching with Applications to Clinical Time Series Modeling |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2410.21154 |