Resolve Highway Conflict in Multi-Autonomous Vehicle Controls with Local State Attention

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ta, Xuan Duy, Le, Bang Giang, Le, Thanh Ha, Ta, Viet Cuong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908544628948992
author Ta, Xuan Duy
Le, Bang Giang
Le, Thanh Ha
Ta, Viet Cuong
author_facet Ta, Xuan Duy
Le, Bang Giang
Le, Thanh Ha
Ta, Viet Cuong
contents In mixed-traffic environments, autonomous vehicles must adapt to human-controlled vehicles and other unusual driving situations. This setting can be framed as a multi-agent reinforcement learning (MARL) environment with full cooperative reward among the autonomous vehicles. While methods such as Multi-agent Proximal Policy Optimization can be effective in training MARL tasks, they often fail to resolve local conflict between agents and are unable to generalize to stochastic events. In this paper, we propose a Local State Attention module to assist the input state representation. By relying on the self-attention operator, the module is expected to compress the essential information of nearby agents to resolve the conflict in traffic situations. Utilizing a simulated highway merging scenario with the priority vehicle as the unexpected event, our approach is able to prioritize other vehicles' information to manage the merging process. The results demonstrate significant improvements in merging efficiency compared to popular baselines, especially in high-density traffic settings.
format Preprint
id arxiv_https___arxiv_org_abs_2506_11445
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Resolve Highway Conflict in Multi-Autonomous Vehicle Controls with Local State Attention
Ta, Xuan Duy
Le, Bang Giang
Le, Thanh Ha
Ta, Viet Cuong
Artificial Intelligence
Machine Learning
In mixed-traffic environments, autonomous vehicles must adapt to human-controlled vehicles and other unusual driving situations. This setting can be framed as a multi-agent reinforcement learning (MARL) environment with full cooperative reward among the autonomous vehicles. While methods such as Multi-agent Proximal Policy Optimization can be effective in training MARL tasks, they often fail to resolve local conflict between agents and are unable to generalize to stochastic events. In this paper, we propose a Local State Attention module to assist the input state representation. By relying on the self-attention operator, the module is expected to compress the essential information of nearby agents to resolve the conflict in traffic situations. Utilizing a simulated highway merging scenario with the priority vehicle as the unexpected event, our approach is able to prioritize other vehicles' information to manage the merging process. The results demonstrate significant improvements in merging efficiency compared to popular baselines, especially in high-density traffic settings.
title Resolve Highway Conflict in Multi-Autonomous Vehicle Controls with Local State Attention
topic Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2506.11445