Socially-Aware Robot Navigation Enhanced by Bidirectional Natural Language Conversations Using Large Language Models
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913752652185600 |
|---|---|
| author | Wen, Congcong Liu, Yifan Bethala, Geeta Chandra Raju Yuan, Shuaihang Huang, Hao Hao, Yu Wang, Mengyu Liu, Yu-Shen Tzes, Anthony Fang, Yi |
| author_facet | Wen, Congcong Liu, Yifan Bethala, Geeta Chandra Raju Yuan, Shuaihang Huang, Hao Hao, Yu Wang, Mengyu Liu, Yu-Shen Tzes, Anthony Fang, Yi |
| contents | Robot navigation is crucial across various domains, yet traditional methods focus on efficiency and obstacle avoidance, often overlooking human behavior in shared spaces. With the rise of service robots, socially aware navigation has gained prominence. However, existing approaches primarily predict pedestrian movements or issue alerts, lacking true human-robot interaction. We introduce Hybrid Soft Actor-Critic with Large Language Model (HSAC-LLM), a novel framework for socially aware navigation. By integrating deep reinforcement learning with large language models, HSAC-LLM enables bidirectional natural language interactions, predicting both continuous and discrete navigation actions. When potential collisions arise, the robot proactively communicates with pedestrians to determine avoidance strategies. Experiments in 2D simulation, Gazebo, and real-world environments demonstrate that HSAC-LLM outperforms state-of-the-art DRL methods in interaction, navigation, and obstacle avoidance. This paradigm advances effective human-robot interactions in dynamic settings. Videos are available at https://hsacllm.github.io/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_04965 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Socially-Aware Robot Navigation Enhanced by Bidirectional Natural Language Conversations Using Large Language Models Wen, Congcong Liu, Yifan Bethala, Geeta Chandra Raju Yuan, Shuaihang Huang, Hao Hao, Yu Wang, Mengyu Liu, Yu-Shen Tzes, Anthony Fang, Yi Robotics Robot navigation is crucial across various domains, yet traditional methods focus on efficiency and obstacle avoidance, often overlooking human behavior in shared spaces. With the rise of service robots, socially aware navigation has gained prominence. However, existing approaches primarily predict pedestrian movements or issue alerts, lacking true human-robot interaction. We introduce Hybrid Soft Actor-Critic with Large Language Model (HSAC-LLM), a novel framework for socially aware navigation. By integrating deep reinforcement learning with large language models, HSAC-LLM enables bidirectional natural language interactions, predicting both continuous and discrete navigation actions. When potential collisions arise, the robot proactively communicates with pedestrians to determine avoidance strategies. Experiments in 2D simulation, Gazebo, and real-world environments demonstrate that HSAC-LLM outperforms state-of-the-art DRL methods in interaction, navigation, and obstacle avoidance. This paradigm advances effective human-robot interactions in dynamic settings. Videos are available at https://hsacllm.github.io/. |
| title | Socially-Aware Robot Navigation Enhanced by Bidirectional Natural Language Conversations Using Large Language Models |
| topic | Robotics |
| url | https://arxiv.org/abs/2409.04965 |