Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Songyang, Fan, Muyang, Li, Weizi, Du, Jing, Li, Shuai
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908467938197504
author Liu, Songyang
Fan, Muyang
Li, Weizi
Du, Jing
Li, Shuai
author_facet Liu, Songyang
Fan, Muyang
Li, Weizi
Du, Jing
Li, Shuai
contents Traffic congestion remains a significant challenge in modern urban networks. Autonomous driving technologies have emerged as a potential solution. Among traffic control methods, reinforcement learning has shown superior performance over traffic signals in various scenarios. However, prior research has largely focused on small-scale networks or isolated intersections, leaving large-scale mixed traffic control largely unexplored. This study presents the first attempt to use decentralized multi-agent reinforcement learning for large-scale mixed traffic control in which some intersections are managed by traffic signals and others by robot vehicles. Evaluating a real-world network in Colorado Springs, CO, USA with 14 intersections, we measure traffic efficiency via average waiting time of vehicles at intersections and the number of vehicles reaching their destinations within a time window (i.e., throughput). At 80% RV penetration rate, our method reduces waiting time from 6.17s to 5.09s and increases throughput from 454 vehicles per 500 seconds to 493 vehicles per 500 seconds, outperforming the baseline of fully signalized intersections. These findings suggest that integrating reinforcement learning-based control large-scale traffic can improve overall efficiency and may inform future urban planning strategies.
format Preprint
id arxiv_https___arxiv_org_abs_2504_04691
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning
Liu, Songyang
Fan, Muyang
Li, Weizi
Du, Jing
Li, Shuai
Machine Learning
Multiagent Systems
Traffic congestion remains a significant challenge in modern urban networks. Autonomous driving technologies have emerged as a potential solution. Among traffic control methods, reinforcement learning has shown superior performance over traffic signals in various scenarios. However, prior research has largely focused on small-scale networks or isolated intersections, leaving large-scale mixed traffic control largely unexplored. This study presents the first attempt to use decentralized multi-agent reinforcement learning for large-scale mixed traffic control in which some intersections are managed by traffic signals and others by robot vehicles. Evaluating a real-world network in Colorado Springs, CO, USA with 14 intersections, we measure traffic efficiency via average waiting time of vehicles at intersections and the number of vehicles reaching their destinations within a time window (i.e., throughput). At 80% RV penetration rate, our method reduces waiting time from 6.17s to 5.09s and increases throughput from 454 vehicles per 500 seconds to 493 vehicles per 500 seconds, outperforming the baseline of fully signalized intersections. These findings suggest that integrating reinforcement learning-based control large-scale traffic can improve overall efficiency and may inform future urban planning strategies.
title Large-Scale Mixed-Traffic and Intersection Control using Multi-agent Reinforcement Learning
topic Machine Learning
Multiagent Systems
url https://arxiv.org/abs/2504.04691