UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Control
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866907936922533888 |
|---|---|
| author | Wang, Maonan Xiong, Xi Kan, Yuheng Xu, Chengcheng Pun, Man-On |
| author_facet | Wang, Maonan Xiong, Xi Kan, Yuheng Xu, Chengcheng Pun, Man-On |
| contents | Traffic congestion is a persistent problem in urban areas, which calls for the development of effective traffic signal control (TSC) systems. While existing Reinforcement Learning (RL)-based methods have shown promising performance in optimizing TSC, it is challenging to generalize these methods across intersections of different structures. In this work, a universal RL-based TSC framework is proposed for Vehicle-to-Everything (V2X) environments. The proposed framework introduces a novel agent design that incorporates a junction matrix to characterize intersection states, making the proposed model applicable to diverse intersections. To equip the proposed RL-based framework with enhanced capability of handling various intersection structures, novel traffic state augmentation methods are tailor-made for signal light control systems. Finally, extensive experimental results derived from multiple intersection configurations confirm the effectiveness of the proposed framework. The source code in this work is available at https://github.com/wmn7/Universal_Light |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_05090 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Control Wang, Maonan Xiong, Xi Kan, Yuheng Xu, Chengcheng Pun, Man-On Systems and Control Machine Learning Traffic congestion is a persistent problem in urban areas, which calls for the development of effective traffic signal control (TSC) systems. While existing Reinforcement Learning (RL)-based methods have shown promising performance in optimizing TSC, it is challenging to generalize these methods across intersections of different structures. In this work, a universal RL-based TSC framework is proposed for Vehicle-to-Everything (V2X) environments. The proposed framework introduces a novel agent design that incorporates a junction matrix to characterize intersection states, making the proposed model applicable to diverse intersections. To equip the proposed RL-based framework with enhanced capability of handling various intersection structures, novel traffic state augmentation methods are tailor-made for signal light control systems. Finally, extensive experimental results derived from multiple intersection configurations confirm the effectiveness of the proposed framework. The source code in this work is available at https://github.com/wmn7/Universal_Light |
| title | UniTSA: A Universal Reinforcement Learning Framework for V2X Traffic Signal Control |
| topic | Systems and Control Machine Learning |
| url | https://arxiv.org/abs/2312.05090 |