A Distributed Approach to Autonomous Intersection Management via Multi-Agent Reinforcement Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Cederle, Matteo, Fabris, Marco, Susto, Gian Antonio
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916484406575104
author Cederle, Matteo
Fabris, Marco
Susto, Gian Antonio
author_facet Cederle, Matteo
Fabris, Marco
Susto, Gian Antonio
contents Autonomous intersection management (AIM) poses significant challenges due to the intricate nature of real-world traffic scenarios and the need for a highly expensive centralised server in charge of simultaneously controlling all the vehicles. This study addresses such issues by proposing a novel distributed approach to AIM utilizing multi-agent reinforcement learning (MARL). We show that by leveraging the 3D surround view technology for advanced assistance systems, autonomous vehicles can accurately navigate intersection scenarios without needing any centralised controller. The contributions of this paper thus include a MARL-based algorithm for the autonomous management of a 4-way intersection and also the introduction of a new strategy called prioritised scenario replay for improved training efficacy. We validate our approach as an innovative alternative to conventional centralised AIM techniques, ensuring the full reproducibility of our results. Specifically, experiments conducted in virtual environments using the SMARTS platform highlight its superiority over benchmarks across various metrics.
format Preprint
id arxiv_https___arxiv_org_abs_2405_08655
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Distributed Approach to Autonomous Intersection Management via Multi-Agent Reinforcement Learning
Cederle, Matteo
Fabris, Marco
Susto, Gian Antonio
Robotics
Artificial Intelligence
Autonomous intersection management (AIM) poses significant challenges due to the intricate nature of real-world traffic scenarios and the need for a highly expensive centralised server in charge of simultaneously controlling all the vehicles. This study addresses such issues by proposing a novel distributed approach to AIM utilizing multi-agent reinforcement learning (MARL). We show that by leveraging the 3D surround view technology for advanced assistance systems, autonomous vehicles can accurately navigate intersection scenarios without needing any centralised controller. The contributions of this paper thus include a MARL-based algorithm for the autonomous management of a 4-way intersection and also the introduction of a new strategy called prioritised scenario replay for improved training efficacy. We validate our approach as an innovative alternative to conventional centralised AIM techniques, ensuring the full reproducibility of our results. Specifically, experiments conducted in virtual environments using the SMARTS platform highlight its superiority over benchmarks across various metrics.
title A Distributed Approach to Autonomous Intersection Management via Multi-Agent Reinforcement Learning
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2405.08655