Generative Expressive Robot Behaviors using Large Language Models
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866929227938398208 |
|---|---|
| author | Mahadevan, Karthik Chien, Jonathan Brown, Noah Xu, Zhuo Parada, Carolina Xia, Fei Zeng, Andy Takayama, Leila Sadigh, Dorsa |
| author_facet | Mahadevan, Karthik Chien, Jonathan Brown, Noah Xu, Zhuo Parada, Carolina Xia, Fei Zeng, Andy Takayama, Leila Sadigh, Dorsa |
| contents | People employ expressive behaviors to effectively communicate and coordinate their actions with others, such as nodding to acknowledge a person glancing at them or saying "excuse me" to pass people in a busy corridor. We would like robots to also demonstrate expressive behaviors in human-robot interaction. Prior work proposes rule-based methods that struggle to scale to new communication modalities or social situations, while data-driven methods require specialized datasets for each social situation the robot is used in. We propose to leverage the rich social context available from large language models (LLMs) and their ability to generate motion based on instructions or user preferences, to generate expressive robot motion that is adaptable and composable, building upon each other. Our approach utilizes few-shot chain-of-thought prompting to translate human language instructions into parametrized control code using the robot's available and learned skills. Through user studies and simulation experiments, we demonstrate that our approach produces behaviors that users found to be competent and easy to understand. Supplementary material can be found at https://generative-expressive-motion.github.io/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_14673 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Generative Expressive Robot Behaviors using Large Language Models Mahadevan, Karthik Chien, Jonathan Brown, Noah Xu, Zhuo Parada, Carolina Xia, Fei Zeng, Andy Takayama, Leila Sadigh, Dorsa Robotics People employ expressive behaviors to effectively communicate and coordinate their actions with others, such as nodding to acknowledge a person glancing at them or saying "excuse me" to pass people in a busy corridor. We would like robots to also demonstrate expressive behaviors in human-robot interaction. Prior work proposes rule-based methods that struggle to scale to new communication modalities or social situations, while data-driven methods require specialized datasets for each social situation the robot is used in. We propose to leverage the rich social context available from large language models (LLMs) and their ability to generate motion based on instructions or user preferences, to generate expressive robot motion that is adaptable and composable, building upon each other. Our approach utilizes few-shot chain-of-thought prompting to translate human language instructions into parametrized control code using the robot's available and learned skills. Through user studies and simulation experiments, we demonstrate that our approach produces behaviors that users found to be competent and easy to understand. Supplementary material can be found at https://generative-expressive-motion.github.io/. |
| title | Generative Expressive Robot Behaviors using Large Language Models |
| topic | Robotics |
| url | https://arxiv.org/abs/2401.14673 |