Saved in:
Bibliographic Details
Main Authors: Geng, Weiyang, Pan, Yiming, Xing, Zhecong, Liu, Dongyu, Liu, Rui, Zhu, Yuan
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2503.13540
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915202922971136
author Geng, Weiyang
Pan, Yiming
Xing, Zhecong
Liu, Dongyu
Liu, Rui
Zhu, Yuan
author_facet Geng, Weiyang
Pan, Yiming
Xing, Zhecong
Liu, Dongyu
Liu, Rui
Zhu, Yuan
contents This study proposes a hybrid model based on Transformers, named MSCMHMST, aimed at addressing key challenges in traffic flow prediction. Traditional single-method approaches show limitations in traffic prediction tasks, whereas hybrid methods, by integrating the strengths of different models, can provide more accurate and robust predictions. The MSCMHMST model introduces a multi-head, multi-scale attention mechanism, allowing the model to parallel process different parts of the data and learn its intrinsic representations from multiple perspectives, thereby enhancing the model's ability to handle complex situations. This mechanism enables the model to capture features at various scales effectively, understanding both short-term changes and long-term trends. Verified through experiments on the PeMS04/08 dataset with specific experimental settings, the MSCMHMST model demonstrated excellent robustness and accuracy in long, medium, and short-term traffic flow predictions. The results indicate that this model has significant potential, offering a new and effective solution for the field of traffic flow prediction.
format Preprint
id arxiv_https___arxiv_org_abs_2503_13540
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MSCMHMST: A traffic flow prediction model based on Transformer
Geng, Weiyang
Pan, Yiming
Xing, Zhecong
Liu, Dongyu
Liu, Rui
Zhu, Yuan
Machine Learning
Artificial Intelligence
This study proposes a hybrid model based on Transformers, named MSCMHMST, aimed at addressing key challenges in traffic flow prediction. Traditional single-method approaches show limitations in traffic prediction tasks, whereas hybrid methods, by integrating the strengths of different models, can provide more accurate and robust predictions. The MSCMHMST model introduces a multi-head, multi-scale attention mechanism, allowing the model to parallel process different parts of the data and learn its intrinsic representations from multiple perspectives, thereby enhancing the model's ability to handle complex situations. This mechanism enables the model to capture features at various scales effectively, understanding both short-term changes and long-term trends. Verified through experiments on the PeMS04/08 dataset with specific experimental settings, the MSCMHMST model demonstrated excellent robustness and accuracy in long, medium, and short-term traffic flow predictions. The results indicate that this model has significant potential, offering a new and effective solution for the field of traffic flow prediction.
title MSCMHMST: A traffic flow prediction model based on Transformer
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2503.13540