UniTraj: Learning a Universal Trajectory Foundation Model from Billion-Scale Worldwide Traces
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866909813922856960 |
|---|---|
| author | Zhu, Yuanshao Yu, James Jianqiao Zhao, Xiangyu Zhou, Xun Han, Liang Wei, Xuetao Liang, Yuxuan |
| author_facet | Zhu, Yuanshao Yu, James Jianqiao Zhao, Xiangyu Zhou, Xun Han, Liang Wei, Xuetao Liang, Yuxuan |
| contents | Building a universal trajectory foundation model is a promising solution to address the limitations of existing trajectory modeling approaches, such as task specificity, regional dependency, and data sensitivity. Despite its potential, data preparation, pre-training strategy development, and architectural design present significant challenges in constructing this model. Therefore, we introduce UniTraj, a Universal Trajectory foundation model that aims to address these limitations through three key innovations. First, we construct WorldTrace, an unprecedented dataset of 2.45 million trajectories with billions of GPS points spanning 70 countries, providing the diverse geographic coverage essential for region-independent modeling. Second, we develop novel pre-training strategies--Adaptive Trajectory Resampling and Self-supervised Trajectory Masking--that enable robust learning from heterogeneous trajectory data with varying sampling rates and quality. Finally, we tailor a flexible model architecture to accommodate a variety of trajectory tasks, effectively capturing complex movement patterns to support broad applicability. Extensive experiments across multiple tasks and real-world datasets demonstrate that UniTraj consistently outperforms existing methods, exhibiting superior scalability, adaptability, and generalization, with WorldTrace serving as an ideal yet non-exclusive training resource. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_03859 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | UniTraj: Learning a Universal Trajectory Foundation Model from Billion-Scale Worldwide Traces Zhu, Yuanshao Yu, James Jianqiao Zhao, Xiangyu Zhou, Xun Han, Liang Wei, Xuetao Liang, Yuxuan Emerging Technologies Artificial Intelligence Machine Learning Social and Information Networks Physics and Society Building a universal trajectory foundation model is a promising solution to address the limitations of existing trajectory modeling approaches, such as task specificity, regional dependency, and data sensitivity. Despite its potential, data preparation, pre-training strategy development, and architectural design present significant challenges in constructing this model. Therefore, we introduce UniTraj, a Universal Trajectory foundation model that aims to address these limitations through three key innovations. First, we construct WorldTrace, an unprecedented dataset of 2.45 million trajectories with billions of GPS points spanning 70 countries, providing the diverse geographic coverage essential for region-independent modeling. Second, we develop novel pre-training strategies--Adaptive Trajectory Resampling and Self-supervised Trajectory Masking--that enable robust learning from heterogeneous trajectory data with varying sampling rates and quality. Finally, we tailor a flexible model architecture to accommodate a variety of trajectory tasks, effectively capturing complex movement patterns to support broad applicability. Extensive experiments across multiple tasks and real-world datasets demonstrate that UniTraj consistently outperforms existing methods, exhibiting superior scalability, adaptability, and generalization, with WorldTrace serving as an ideal yet non-exclusive training resource. |
| title | UniTraj: Learning a Universal Trajectory Foundation Model from Billion-Scale Worldwide Traces |
| topic | Emerging Technologies Artificial Intelligence Machine Learning Social and Information Networks Physics and Society |
| url | https://arxiv.org/abs/2411.03859 |