Saved in:
Bibliographic Details
Main Authors: Hu, Penglin, Zhao, Chunhui, Pan, Quan
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2503.06741
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929750880026624
author Hu, Penglin
Zhao, Chunhui
Pan, Quan
author_facet Hu, Penglin
Zhao, Chunhui
Pan, Quan
contents In practical application, the pursuit-evasion game (PEG) often involves multiple complex and conflicting objectives. The single-objective reinforcement learning (RL) usually focuses on a single optimization objective, and it is difficult to find the optimal balance among multiple objectives. This paper proposes a three-objective RL algorithm based on fuzzy Q-learning (FQL) to solve the PEG with different optimization objectives. First, the multi-objective FQL algorithm is introduced, which uses the reward function to represent three optimization objectives: evading pursuit, reaching target, and avoiding obstacle. Second, a multi-objective evaluation method and action selection strategy based on three-dimensional hypervolume are designed, which solved the dilemma of exploration-exploitation. By sampling the Pareto front, the update rule of the global strategy is obtained. The proposed algorithm reduces computational load while ensuring exploration ability. Finally, the performance of the algorithm is verified by simulation results.
format Preprint
id arxiv_https___arxiv_org_abs_2503_06741
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Novel Multi-Objective Reinforcement Learning Algorithm for Pursuit-Evasion Game
Hu, Penglin
Zhao, Chunhui
Pan, Quan
Systems and Control
In practical application, the pursuit-evasion game (PEG) often involves multiple complex and conflicting objectives. The single-objective reinforcement learning (RL) usually focuses on a single optimization objective, and it is difficult to find the optimal balance among multiple objectives. This paper proposes a three-objective RL algorithm based on fuzzy Q-learning (FQL) to solve the PEG with different optimization objectives. First, the multi-objective FQL algorithm is introduced, which uses the reward function to represent three optimization objectives: evading pursuit, reaching target, and avoiding obstacle. Second, a multi-objective evaluation method and action selection strategy based on three-dimensional hypervolume are designed, which solved the dilemma of exploration-exploitation. By sampling the Pareto front, the update rule of the global strategy is obtained. The proposed algorithm reduces computational load while ensuring exploration ability. Finally, the performance of the algorithm is verified by simulation results.
title A Novel Multi-Objective Reinforcement Learning Algorithm for Pursuit-Evasion Game
topic Systems and Control
url https://arxiv.org/abs/2503.06741