Robust Traffic Forecasting against Spatial Shift over Years

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Hongjun, Chen, Jiyuan, Pan, Tong, Dong, Zheng, Zhang, Lingyu, Jiang, Renhe, Song, Xuan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916417594458112
author Wang, Hongjun
Chen, Jiyuan
Pan, Tong
Dong, Zheng
Zhang, Lingyu
Jiang, Renhe
Song, Xuan
author_facet Wang, Hongjun
Chen, Jiyuan
Pan, Tong
Dong, Zheng
Zhang, Lingyu
Jiang, Renhe
Song, Xuan
contents Recent advancements in Spatiotemporal Graph Neural Networks (ST-GNNs) and Transformers have demonstrated promising potential for traffic forecasting by effectively capturing both temporal and spatial correlations. The generalization ability of spatiotemporal models has received considerable attention in recent scholarly discourse. However, no substantive datasets specifically addressing traffic out-of-distribution (OOD) scenarios have been proposed. Existing ST-OOD methods are either constrained to testing on extant data or necessitate manual modifications to the dataset. Consequently, the generalization capacity of current spatiotemporal models in OOD scenarios remains largely underexplored. In this paper, we investigate state-of-the-art models using newly proposed traffic OOD benchmarks and, surprisingly, find that these models experience a significant decline in performance. Through meticulous analysis, we attribute this decline to the models' inability to adapt to previously unobserved spatial relationships. To address this challenge, we propose a novel Mixture of Experts (MoE) framework, which learns a set of graph generators (i.e., graphons) during training and adaptively combines them to generate new graphs based on novel environmental conditions to handle spatial distribution shifts during testing. We further extend this concept to the Transformer architecture, achieving substantial improvements. Our method is both parsimonious and efficacious, and can be seamlessly integrated into any spatiotemporal model, outperforming current state-of-the-art approaches in addressing spatial dynamics.
format Preprint
id arxiv_https___arxiv_org_abs_2410_00373
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Robust Traffic Forecasting against Spatial Shift over Years
Wang, Hongjun
Chen, Jiyuan
Pan, Tong
Dong, Zheng
Zhang, Lingyu
Jiang, Renhe
Song, Xuan
Machine Learning
Artificial Intelligence
Databases
Recent advancements in Spatiotemporal Graph Neural Networks (ST-GNNs) and Transformers have demonstrated promising potential for traffic forecasting by effectively capturing both temporal and spatial correlations. The generalization ability of spatiotemporal models has received considerable attention in recent scholarly discourse. However, no substantive datasets specifically addressing traffic out-of-distribution (OOD) scenarios have been proposed. Existing ST-OOD methods are either constrained to testing on extant data or necessitate manual modifications to the dataset. Consequently, the generalization capacity of current spatiotemporal models in OOD scenarios remains largely underexplored. In this paper, we investigate state-of-the-art models using newly proposed traffic OOD benchmarks and, surprisingly, find that these models experience a significant decline in performance. Through meticulous analysis, we attribute this decline to the models' inability to adapt to previously unobserved spatial relationships. To address this challenge, we propose a novel Mixture of Experts (MoE) framework, which learns a set of graph generators (i.e., graphons) during training and adaptively combines them to generate new graphs based on novel environmental conditions to handle spatial distribution shifts during testing. We further extend this concept to the Transformer architecture, achieving substantial improvements. Our method is both parsimonious and efficacious, and can be seamlessly integrated into any spatiotemporal model, outperforming current state-of-the-art approaches in addressing spatial dynamics.
title Robust Traffic Forecasting against Spatial Shift over Years
topic Machine Learning
Artificial Intelligence
Databases
url https://arxiv.org/abs/2410.00373