Saved in:
Bibliographic Details
Main Authors: Li, Ruitong, Zhang, Lin, Zhao, Yuenan, Liu, Chengxin, Song, Ran, Zhang, Wei
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2512.24284
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917177520553984
author Li, Ruitong
Zhang, Lin
Zhao, Yuenan
Liu, Chengxin
Song, Ran
Zhang, Wei
author_facet Li, Ruitong
Zhang, Lin
Zhao, Yuenan
Liu, Chengxin
Song, Ran
Zhang, Wei
contents Deep reinforcement learning (DRL) methods have demonstrated potential for autonomous navigation and obstacle avoidance of unmanned ground vehicles (UGVs) in crowded environments. Most existing approaches rely on single-frame observation and employ simple concatenation for multi-modal fusion, which limits their ability to capture temporal context and hinders dynamic adaptability. To address these challenges, we propose a DRL-based navigation framework, DRL-TH, which leverages temporal graph attention and hierarchical graph pooling to integrate historical observations and adaptively fuse multi-modal information. Specifically, we introduce a temporal-guided graph attention network (TG-GAT) that incorporates temporal weights into attention scores to capture correlations between consecutive frames, thereby enabling the implicit estimation of scene evolution. In addition, we design a graph hierarchical abstraction module (GHAM) that applies hierarchical pooling and learnable weighted fusion to dynamically integrate RGB and LiDAR features, achieving balanced representation across multiple scales. Extensive experiments demonstrate that our DRL-TH outperforms existing methods in various crowded environments. We also implemented DRL-TH control policy on a real UGV and showed that it performed well in real world scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2512_24284
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environments
Li, Ruitong
Zhang, Lin
Zhao, Yuenan
Liu, Chengxin
Song, Ran
Zhang, Wei
Robotics
Artificial Intelligence
Deep reinforcement learning (DRL) methods have demonstrated potential for autonomous navigation and obstacle avoidance of unmanned ground vehicles (UGVs) in crowded environments. Most existing approaches rely on single-frame observation and employ simple concatenation for multi-modal fusion, which limits their ability to capture temporal context and hinders dynamic adaptability. To address these challenges, we propose a DRL-based navigation framework, DRL-TH, which leverages temporal graph attention and hierarchical graph pooling to integrate historical observations and adaptively fuse multi-modal information. Specifically, we introduce a temporal-guided graph attention network (TG-GAT) that incorporates temporal weights into attention scores to capture correlations between consecutive frames, thereby enabling the implicit estimation of scene evolution. In addition, we design a graph hierarchical abstraction module (GHAM) that applies hierarchical pooling and learnable weighted fusion to dynamically integrate RGB and LiDAR features, achieving balanced representation across multiple scales. Extensive experiments demonstrate that our DRL-TH outperforms existing methods in various crowded environments. We also implemented DRL-TH control policy on a real UGV and showed that it performed well in real world scenarios.
title DRL-TH: Jointly Utilizing Temporal Graph Attention and Hierarchical Fusion for UGV Navigation in Crowded Environments
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2512.24284