Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programming
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909274176749568 |
|---|---|
| author | Ge, Yate Dai, Yi Shan, Run Li, Kechun Hu, Yuanda Sun, Xiaohua |
| author_facet | Ge, Yate Dai, Yi Shan, Run Li, Kechun Hu, Yuanda Sun, Xiaohua |
| contents | End-user development allows everyday users to tailor service robots or applications to their needs. One user-friendly approach is natural language programming. However, it encounters challenges such as an expansive user expression space and limited support for debugging and editing, which restrict its application in end-user programming. The emergence of large language models (LLMs) offers promising avenues for the translation and interpretation between human language instructions and the code executed by robots, but their application in end-user programming systems requires further study. We introduce Cocobo, a natural language programming system with interactive diagrams powered by LLMs. Cocobo employs LLMs to understand users' authoring intentions, generate and explain robot programs, and facilitate the conversion between executable code and flowchart representations. Our user study shows that Cocobo has a low learning curve, enabling even users with zero coding experience to customize robot programs successfully. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_20712 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programming Ge, Yate Dai, Yi Shan, Run Li, Kechun Hu, Yuanda Sun, Xiaohua Human-Computer Interaction Artificial Intelligence End-user development allows everyday users to tailor service robots or applications to their needs. One user-friendly approach is natural language programming. However, it encounters challenges such as an expansive user expression space and limited support for debugging and editing, which restrict its application in end-user programming. The emergence of large language models (LLMs) offers promising avenues for the translation and interpretation between human language instructions and the code executed by robots, but their application in end-user programming systems requires further study. We introduce Cocobo, a natural language programming system with interactive diagrams powered by LLMs. Cocobo employs LLMs to understand users' authoring intentions, generate and explain robot programs, and facilitate the conversion between executable code and flowchart representations. Our user study shows that Cocobo has a low learning curve, enabling even users with zero coding experience to customize robot programs successfully. |
| title | Cocobo: Exploring Large Language Models as the Engine for End-User Robot Programming |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2407.20712 |