LANCAR: Leveraging Language for Context-Aware Robot Locomotion in Unstructured Environments
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2023
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912062290001920 |
|---|---|
| author | Shek, Chak Lam Wu, Xiyang Suttle, Wesley A. Busart, Carl Zaroukian, Erin Manocha, Dinesh Tokekar, Pratap Bedi, Amrit Singh |
| author_facet | Shek, Chak Lam Wu, Xiyang Suttle, Wesley A. Busart, Carl Zaroukian, Erin Manocha, Dinesh Tokekar, Pratap Bedi, Amrit Singh |
| contents | Navigating robots through unstructured terrains is challenging, primarily due to the dynamic environmental changes. While humans adeptly navigate such terrains by using context from their observations, creating a similar context-aware navigation system for robots is difficult. The essence of the issue lies in the acquisition and interpretation of context information, a task complicated by the inherent ambiguity of human language. In this work, we introduce LANCAR, which addresses this issue by combining a context translator with reinforcement learning (RL) agents for context-aware locomotion. LANCAR allows robots to comprehend context information through Large Language Models (LLMs) sourced from human observers and convert this information into actionable context embeddings. These embeddings, combined with the robot's sensor data, provide a complete input for the RL agent's policy network. We provide an extensive evaluation of LANCAR under different levels of context ambiguity and compare with alternative methods. The experimental results showcase the superior generalizability and adaptability across different terrains. Notably, LANCAR shows at least a 7.4% increase in episodic reward over the best alternatives, highlighting its potential to enhance robotic navigation in unstructured environments. More details and experiment videos could be found in http://raaslab.org/projects/LLM_Context_Estimation/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_00481 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | LANCAR: Leveraging Language for Context-Aware Robot Locomotion in Unstructured Environments Shek, Chak Lam Wu, Xiyang Suttle, Wesley A. Busart, Carl Zaroukian, Erin Manocha, Dinesh Tokekar, Pratap Bedi, Amrit Singh Robotics Navigating robots through unstructured terrains is challenging, primarily due to the dynamic environmental changes. While humans adeptly navigate such terrains by using context from their observations, creating a similar context-aware navigation system for robots is difficult. The essence of the issue lies in the acquisition and interpretation of context information, a task complicated by the inherent ambiguity of human language. In this work, we introduce LANCAR, which addresses this issue by combining a context translator with reinforcement learning (RL) agents for context-aware locomotion. LANCAR allows robots to comprehend context information through Large Language Models (LLMs) sourced from human observers and convert this information into actionable context embeddings. These embeddings, combined with the robot's sensor data, provide a complete input for the RL agent's policy network. We provide an extensive evaluation of LANCAR under different levels of context ambiguity and compare with alternative methods. The experimental results showcase the superior generalizability and adaptability across different terrains. Notably, LANCAR shows at least a 7.4% increase in episodic reward over the best alternatives, highlighting its potential to enhance robotic navigation in unstructured environments. More details and experiment videos could be found in http://raaslab.org/projects/LLM_Context_Estimation/ |
| title | LANCAR: Leveraging Language for Context-Aware Robot Locomotion in Unstructured Environments |
| topic | Robotics |
| url | https://arxiv.org/abs/2310.00481 |