Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Guo, Qinghong, Wang, Yu, Cao, Ji, Zheng, Tongya, Dai, Junshu, Hu, Bingde, Liu, Shunyu, Jin, Canghong
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2511.06633
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909922228174848
author Guo, Qinghong
Wang, Yu
Cao, Ji
Zheng, Tongya
Dai, Junshu
Hu, Bingde
Liu, Shunyu
Jin, Canghong
author_facet Guo, Qinghong
Wang, Yu
Cao, Ji
Zheng, Tongya
Dai, Junshu
Hu, Bingde
Liu, Shunyu
Jin, Canghong
contents Road network representation learning (RNRL) has attracted increasing attention from both researchers and practitioners as various spatiotemporal tasks are emerging. Recent advanced methods leverage Graph Neural Networks (GNNs) and contrastive learning to characterize the spatial structure of road segments in a self-supervised paradigm. However, spatial heterogeneity and temporal dynamics of road networks raise severe challenges to the neighborhood smoothing mechanism of self-supervised GNNs. To address these issues, we propose a $\textbf{D}$ual-branch $\textbf{S}$patial-$\textbf{T}$emporal self-supervised representation framework for enhanced road representations, termed as DST. On one hand, DST designs a mix-hop transition matrix for graph convolution to incorporate dynamic relations of roads from trajectories. Besides, DST contrasts road representations of the vanilla road network against that of the hypergraph in a spatial self-supervised way. The hypergraph is newly built based on three types of hyperedges to capture long-range relations. On the other hand, DST performs next token prediction as the temporal self-supervised task on the sequences of traffic dynamics based on a causal Transformer, which is further regularized by differentiating traffic modes of weekdays from those of weekends. Extensive experiments against state-of-the-art methods verify the superiority of our proposed framework. Moreover, the comprehensive spatiotemporal modeling facilitates DST to excel in zero-shot learning scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2511_06633
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Dual-branch Spatial-Temporal Self-supervised Representation for Enhanced Road Network Learning
Guo, Qinghong
Wang, Yu
Cao, Ji
Zheng, Tongya
Dai, Junshu
Hu, Bingde
Liu, Shunyu
Jin, Canghong
Machine Learning
Road network representation learning (RNRL) has attracted increasing attention from both researchers and practitioners as various spatiotemporal tasks are emerging. Recent advanced methods leverage Graph Neural Networks (GNNs) and contrastive learning to characterize the spatial structure of road segments in a self-supervised paradigm. However, spatial heterogeneity and temporal dynamics of road networks raise severe challenges to the neighborhood smoothing mechanism of self-supervised GNNs. To address these issues, we propose a $\textbf{D}$ual-branch $\textbf{S}$patial-$\textbf{T}$emporal self-supervised representation framework for enhanced road representations, termed as DST. On one hand, DST designs a mix-hop transition matrix for graph convolution to incorporate dynamic relations of roads from trajectories. Besides, DST contrasts road representations of the vanilla road network against that of the hypergraph in a spatial self-supervised way. The hypergraph is newly built based on three types of hyperedges to capture long-range relations. On the other hand, DST performs next token prediction as the temporal self-supervised task on the sequences of traffic dynamics based on a causal Transformer, which is further regularized by differentiating traffic modes of weekdays from those of weekends. Extensive experiments against state-of-the-art methods verify the superiority of our proposed framework. Moreover, the comprehensive spatiotemporal modeling facilitates DST to excel in zero-shot learning scenarios.
title Dual-branch Spatial-Temporal Self-supervised Representation for Enhanced Road Network Learning
topic Machine Learning
url https://arxiv.org/abs/2511.06633