Learning Multi-Modal Mobility Dynamics for Generalized Next Location Recommendation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Dai, Junshu, Wang, Yu, Zheng, Tongya, Ji, Wei, Guo, Qinghong, Cao, Ji, Song, Jie, Jin, Canghong, Song, Mingli
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914221985366016
author Dai, Junshu
Wang, Yu
Zheng, Tongya
Ji, Wei
Guo, Qinghong
Cao, Ji
Song, Jie
Jin, Canghong
Song, Mingli
author_facet Dai, Junshu
Wang, Yu
Zheng, Tongya
Ji, Wei
Guo, Qinghong
Cao, Ji
Song, Jie
Jin, Canghong
Song, Mingli
contents The precise prediction of human mobility has produced significant socioeconomic impacts, such as location recommendations and evacuation suggestions. However, existing methods suffer from limited generalization capability: unimodal approaches are constrained by data sparsity and inherent biases, while multi-modal methods struggle to effectively capture mobility dynamics caused by the semantic gap between static multi-modal representation and spatial-temporal dynamics. Therefore, we leverage multi-modal spatial-temporal knowledge to characterize mobility dynamics for the location recommendation task, dubbed as \textbf{M}ulti-\textbf{M}odal \textbf{Mob}ility (\textbf{M}$^3$\textbf{ob}). First, we construct a unified spatial-temporal relational graph (STRG) for multi-modal representation, by leveraging the functional semantics and spatial-temporal knowledge captured by the large language models (LLMs)-enhanced spatial-temporal knowledge graph (STKG). Second, we design a gating mechanism to fuse spatial-temporal graph representations of different modalities, and propose an STKG-guided cross-modal alignment to inject spatial-temporal dynamic knowledge into the static image modality. Extensive experiments on six public datasets show that our proposed method not only achieves consistent improvements in normal scenarios but also exhibits significant generalization ability in abnormal scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2512_22605
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Learning Multi-Modal Mobility Dynamics for Generalized Next Location Recommendation
Dai, Junshu
Wang, Yu
Zheng, Tongya
Ji, Wei
Guo, Qinghong
Cao, Ji
Song, Jie
Jin, Canghong
Song, Mingli
Artificial Intelligence
Computer Vision and Pattern Recognition
The precise prediction of human mobility has produced significant socioeconomic impacts, such as location recommendations and evacuation suggestions. However, existing methods suffer from limited generalization capability: unimodal approaches are constrained by data sparsity and inherent biases, while multi-modal methods struggle to effectively capture mobility dynamics caused by the semantic gap between static multi-modal representation and spatial-temporal dynamics. Therefore, we leverage multi-modal spatial-temporal knowledge to characterize mobility dynamics for the location recommendation task, dubbed as \textbf{M}ulti-\textbf{M}odal \textbf{Mob}ility (\textbf{M}$^3$\textbf{ob}). First, we construct a unified spatial-temporal relational graph (STRG) for multi-modal representation, by leveraging the functional semantics and spatial-temporal knowledge captured by the large language models (LLMs)-enhanced spatial-temporal knowledge graph (STKG). Second, we design a gating mechanism to fuse spatial-temporal graph representations of different modalities, and propose an STKG-guided cross-modal alignment to inject spatial-temporal dynamic knowledge into the static image modality. Extensive experiments on six public datasets show that our proposed method not only achieves consistent improvements in normal scenarios but also exhibits significant generalization ability in abnormal scenarios.
title Learning Multi-Modal Mobility Dynamics for Generalized Next Location Recommendation
topic Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.22605