Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2501.05411 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866929668352901120 |
|---|---|
| author | Liu, Wei Wang, Ruiyang Wang, Haonan Liu, Guangwei |
| author_facet | Liu, Wei Wang, Ruiyang Wang, Haonan Liu, Guangwei |
| contents | Q-learning methods are widely used in robot path planning but often face challenges of inefficient search and slow convergence. We propose an Improved Q-learning (IQL) framework that enhances standard Q-learning in two significant ways. First, we introduce the Path Adaptive Collaborative Optimization (PACO) algorithm to optimize Q-table initialization, providing better initial estimates and accelerating learning. Second, we incorporate a Utility-Controlled Heuristic (UCH) mechanism with dynamically tuned parameters to optimize the reward function, enhancing the algorithm's accuracy and effectiveness in path-planning tasks. Extensive experiments in three different raster grid environments validate the superior performance of our IQL framework. The results demonstrate that our IQL algorithm outperforms existing methods, including FIQL, PP-QL-based CPP, DFQL, and QMABC algorithms, in terms of path-planning capabilities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_05411 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Adaptive Path-Planning for Autonomous Robots: A UCH-Enhanced Q-Learning Approach Liu, Wei Wang, Ruiyang Wang, Haonan Liu, Guangwei Robotics Q-learning methods are widely used in robot path planning but often face challenges of inefficient search and slow convergence. We propose an Improved Q-learning (IQL) framework that enhances standard Q-learning in two significant ways. First, we introduce the Path Adaptive Collaborative Optimization (PACO) algorithm to optimize Q-table initialization, providing better initial estimates and accelerating learning. Second, we incorporate a Utility-Controlled Heuristic (UCH) mechanism with dynamically tuned parameters to optimize the reward function, enhancing the algorithm's accuracy and effectiveness in path-planning tasks. Extensive experiments in three different raster grid environments validate the superior performance of our IQL framework. The results demonstrate that our IQL algorithm outperforms existing methods, including FIQL, PP-QL-based CPP, DFQL, and QMABC algorithms, in terms of path-planning capabilities. |
| title | Adaptive Path-Planning for Autonomous Robots: A UCH-Enhanced Q-Learning Approach |
| topic | Robotics |
| url | https://arxiv.org/abs/2501.05411 |