Deep Reinforcement Learning with anticipatory reward in LSTM for Collision Avoidance of Mobile Robots

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Poulet, Olivier, Guinand, Frédéric, Guérin, François
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918122122903552
author Poulet, Olivier
Guinand, Frédéric
Guérin, François
author_facet Poulet, Olivier
Guinand, Frédéric
Guérin, François
contents This article proposes a collision risk anticipation method based on short-term prediction of the agents position. A Long Short-Term Memory (LSTM) model, trained on past trajectories, is used to estimate the next position of each robot. This prediction allows us to define an anticipated collision risk by dynamically modulating the reward of a Deep Q-Learning Network (DQN) agent. The approach is tested in a constrained environment, where two robots move without communication or identifiers. Despite a limited sampling frequency (1 Hz), the results show a significant decrease of the collisions number and a stability improvement. The proposed method, which is computationally inexpensive, appears particularly attractive for implementation on embedded systems.
format Preprint
id arxiv_https___arxiv_org_abs_2508_07941
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Deep Reinforcement Learning with anticipatory reward in LSTM for Collision Avoidance of Mobile Robots
Poulet, Olivier
Guinand, Frédéric
Guérin, François
Artificial Intelligence
This article proposes a collision risk anticipation method based on short-term prediction of the agents position. A Long Short-Term Memory (LSTM) model, trained on past trajectories, is used to estimate the next position of each robot. This prediction allows us to define an anticipated collision risk by dynamically modulating the reward of a Deep Q-Learning Network (DQN) agent. The approach is tested in a constrained environment, where two robots move without communication or identifiers. Despite a limited sampling frequency (1 Hz), the results show a significant decrease of the collisions number and a stability improvement. The proposed method, which is computationally inexpensive, appears particularly attractive for implementation on embedded systems.
title Deep Reinforcement Learning with anticipatory reward in LSTM for Collision Avoidance of Mobile Robots
topic Artificial Intelligence
url https://arxiv.org/abs/2508.07941