Remote Life Support Robot Interface System for Global Task Planning and Local Action Expansion Using Foundation Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915021980696576 |
|---|---|
| author | Obinata, Yoshiki Jia, Haoyu Kawaharazuka, Kento Kanazawa, Naoaki Okada, Kei |
| author_facet | Obinata, Yoshiki Jia, Haoyu Kawaharazuka, Kento Kanazawa, Naoaki Okada, Kei |
| contents | Robot systems capable of executing tasks based on language instructions have been actively researched. It is challenging to convey uncertain information that can only be determined on-site with a single language instruction to the robot. In this study, we propose a system that includes ambiguous parts as template variables in language instructions to communicate the information to be collected and the options to be presented to the robot for predictable uncertain events. This study implements prompt generation for each robot action function based on template variables to collect information, and a feedback system for presenting and selecting options based on template variables for user-to-robot communication. The effectiveness of the proposed system was demonstrated through its application to real-life support tasks performed by the robot. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_10038 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Remote Life Support Robot Interface System for Global Task Planning and Local Action Expansion Using Foundation Models Obinata, Yoshiki Jia, Haoyu Kawaharazuka, Kento Kanazawa, Naoaki Okada, Kei Robotics Robot systems capable of executing tasks based on language instructions have been actively researched. It is challenging to convey uncertain information that can only be determined on-site with a single language instruction to the robot. In this study, we propose a system that includes ambiguous parts as template variables in language instructions to communicate the information to be collected and the options to be presented to the robot for predictable uncertain events. This study implements prompt generation for each robot action function based on template variables to collect information, and a feedback system for presenting and selecting options based on template variables for user-to-robot communication. The effectiveness of the proposed system was demonstrated through its application to real-life support tasks performed by the robot. |
| title | Remote Life Support Robot Interface System for Global Task Planning and Local Action Expansion Using Foundation Models |
| topic | Robotics |
| url | https://arxiv.org/abs/2411.10038 |