SSMT: Few-Shot Traffic Forecasting with Single Source Meta-Transfer

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bhaumik, Kishor Kumar, Kim, Minha, Niloy, Fahim Faisal, Ali, Amin Ahsan, Woo, Simon S.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910658033876992
author Bhaumik, Kishor Kumar
Kim, Minha
Niloy, Fahim Faisal
Ali, Amin Ahsan
Woo, Simon S.
author_facet Bhaumik, Kishor Kumar
Kim, Minha
Niloy, Fahim Faisal
Ali, Amin Ahsan
Woo, Simon S.
contents Traffic forecasting in Intelligent Transportation Systems (ITS) is vital for intelligent traffic prediction. Yet, ITS often relies on data from traffic sensors or vehicle devices, where certain cities might not have all those smart devices or enabling infrastructures. Also, recent studies have employed meta-learning to generalize spatial-temporal traffic networks, utilizing data from multiple cities for effective traffic forecasting for data-scarce target cities. However, collecting data from multiple cities can be costly and time-consuming. To tackle this challenge, we introduce Single Source Meta-Transfer Learning (SSMT) which relies only on a single source city for traffic prediction. Our method harnesses this transferred knowledge to enable few-shot traffic forecasting, particularly when the target city possesses limited data. Specifically, we use memory-augmented attention to store the heterogeneous spatial knowledge from the source city and selectively recall them for the data-scarce target city. We extend the idea of sinusoidal positional encoding to establish meta-learning tasks by leveraging diverse temporal traffic patterns from the source city. Moreover, to capture a more generalized representation of the positions we introduced a meta-positional encoding that learns the most optimal representation of the temporal pattern across all the tasks. We experiment on five real-world benchmark datasets to demonstrate that our method outperforms several existing methods in time series traffic prediction.
format Preprint
id arxiv_https___arxiv_org_abs_2410_15589
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SSMT: Few-Shot Traffic Forecasting with Single Source Meta-Transfer
Bhaumik, Kishor Kumar
Kim, Minha
Niloy, Fahim Faisal
Ali, Amin Ahsan
Woo, Simon S.
Machine Learning
Traffic forecasting in Intelligent Transportation Systems (ITS) is vital for intelligent traffic prediction. Yet, ITS often relies on data from traffic sensors or vehicle devices, where certain cities might not have all those smart devices or enabling infrastructures. Also, recent studies have employed meta-learning to generalize spatial-temporal traffic networks, utilizing data from multiple cities for effective traffic forecasting for data-scarce target cities. However, collecting data from multiple cities can be costly and time-consuming. To tackle this challenge, we introduce Single Source Meta-Transfer Learning (SSMT) which relies only on a single source city for traffic prediction. Our method harnesses this transferred knowledge to enable few-shot traffic forecasting, particularly when the target city possesses limited data. Specifically, we use memory-augmented attention to store the heterogeneous spatial knowledge from the source city and selectively recall them for the data-scarce target city. We extend the idea of sinusoidal positional encoding to establish meta-learning tasks by leveraging diverse temporal traffic patterns from the source city. Moreover, to capture a more generalized representation of the positions we introduced a meta-positional encoding that learns the most optimal representation of the temporal pattern across all the tasks. We experiment on five real-world benchmark datasets to demonstrate that our method outperforms several existing methods in time series traffic prediction.
title SSMT: Few-Shot Traffic Forecasting with Single Source Meta-Transfer
topic Machine Learning
url https://arxiv.org/abs/2410.15589