Efficient Reinforcement Learning of Task Planners for Robotic Palletization through Iterative Action Masking Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917633035599872 |
|---|---|
| author | Wu, Zheng Li, Yichuan Zhan, Wei Liu, Changliu Liu, Yun-Hui Tomizuka, Masayoshi |
| author_facet | Wu, Zheng Li, Yichuan Zhan, Wei Liu, Changliu Liu, Yun-Hui Tomizuka, Masayoshi |
| contents | The development of robotic systems for palletization in logistics scenarios is of paramount importance, addressing critical efficiency and precision demands in supply chain management. This paper investigates the application of Reinforcement Learning (RL) in enhancing task planning for such robotic systems. Confronted with the substantial challenge of a vast action space, which is a significant impediment to efficiently apply out-of-the-shelf RL methods, our study introduces a novel method of utilizing supervised learning to iteratively prune and manage the action space effectively. By reducing the complexity of the action space, our approach not only accelerates the learning phase but also ensures the effectiveness and reliability of the task planning in robotic palletization. The experimental results underscore the efficacy of this method, highlighting its potential in improving the performance of RL applications in complex and high-dimensional environments like logistics palletization. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_04772 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Efficient Reinforcement Learning of Task Planners for Robotic Palletization through Iterative Action Masking Learning Wu, Zheng Li, Yichuan Zhan, Wei Liu, Changliu Liu, Yun-Hui Tomizuka, Masayoshi Robotics The development of robotic systems for palletization in logistics scenarios is of paramount importance, addressing critical efficiency and precision demands in supply chain management. This paper investigates the application of Reinforcement Learning (RL) in enhancing task planning for such robotic systems. Confronted with the substantial challenge of a vast action space, which is a significant impediment to efficiently apply out-of-the-shelf RL methods, our study introduces a novel method of utilizing supervised learning to iteratively prune and manage the action space effectively. By reducing the complexity of the action space, our approach not only accelerates the learning phase but also ensures the effectiveness and reliability of the task planning in robotic palletization. The experimental results underscore the efficacy of this method, highlighting its potential in improving the performance of RL applications in complex and high-dimensional environments like logistics palletization. |
| title | Efficient Reinforcement Learning of Task Planners for Robotic Palletization through Iterative Action Masking Learning |
| topic | Robotics |
| url | https://arxiv.org/abs/2404.04772 |