Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Ruiqi, Hou, Jing, Walter, Florian, Gu, Shangding, Guan, Jiayi, Röhrbein, Florian, Du, Yali, Cai, Panpan, Chen, Guang, Knoll, Alois
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917752045830144
author Zhang, Ruiqi
Hou, Jing
Walter, Florian
Gu, Shangding
Guan, Jiayi
Röhrbein, Florian
Du, Yali
Cai, Panpan
Chen, Guang
Knoll, Alois
author_facet Zhang, Ruiqi
Hou, Jing
Walter, Florian
Gu, Shangding
Guan, Jiayi
Röhrbein, Florian
Du, Yali
Cai, Panpan
Chen, Guang
Knoll, Alois
contents Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain, multi-agent RL (MARL) not only need to learn the control policy but also requires consideration regarding interactions with all other agents in the environment, mutual influences among different system components, and the distribution of computational resources. This augments the complexity of algorithmic design and poses higher requirements on computational resources. Simultaneously, simulators are crucial to obtain realistic data, which is the fundamentals of RL. In this paper, we first propose a series of metrics of simulators and summarize the features of existing benchmarks. Second, to ease comprehension, we recall the foundational knowledge and then synthesize the recently advanced studies of MARL-related autonomous driving and intelligent transportation systems. Specifically, we examine their environmental modeling, state representation, perception units, and algorithm design. Conclusively, we discuss open challenges as well as prospects and opportunities. We hope this paper can help the researchers integrate MARL technologies and trigger more insightful ideas toward the intelligent and autonomous driving.
format Preprint
id arxiv_https___arxiv_org_abs_2408_09675
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey
Zhang, Ruiqi
Hou, Jing
Walter, Florian
Gu, Shangding
Guan, Jiayi
Röhrbein, Florian
Du, Yali
Cai, Panpan
Chen, Guang
Knoll, Alois
Artificial Intelligence
Multiagent Systems
Robotics
Reinforcement Learning (RL) is a potent tool for sequential decision-making and has achieved performance surpassing human capabilities across many challenging real-world tasks. As the extension of RL in the multi-agent system domain, multi-agent RL (MARL) not only need to learn the control policy but also requires consideration regarding interactions with all other agents in the environment, mutual influences among different system components, and the distribution of computational resources. This augments the complexity of algorithmic design and poses higher requirements on computational resources. Simultaneously, simulators are crucial to obtain realistic data, which is the fundamentals of RL. In this paper, we first propose a series of metrics of simulators and summarize the features of existing benchmarks. Second, to ease comprehension, we recall the foundational knowledge and then synthesize the recently advanced studies of MARL-related autonomous driving and intelligent transportation systems. Specifically, we examine their environmental modeling, state representation, perception units, and algorithm design. Conclusively, we discuss open challenges as well as prospects and opportunities. We hope this paper can help the researchers integrate MARL technologies and trigger more insightful ideas toward the intelligent and autonomous driving.
title Multi-Agent Reinforcement Learning for Autonomous Driving: A Survey
topic Artificial Intelligence
Multiagent Systems
Robotics
url https://arxiv.org/abs/2408.09675