VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911957709225984 |
|---|---|
| author | Padmanabha, Akhil Yuan, Jessie Gupta, Janavi Karachiwalla, Zulekha Majidi, Carmel Admoni, Henny Erickson, Zackory |
| author_facet | Padmanabha, Akhil Yuan, Jessie Gupta, Janavi Karachiwalla, Zulekha Majidi, Carmel Admoni, Henny Erickson, Zackory |
| contents | Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living. Speech interfaces, especially ones that utilize Large Language Models (LLMs), can enable individuals to effectively and naturally communicate high-level commands and nuanced preferences to robots. Frameworks for integrating LLMs as interfaces to robots for high level task planning and code generation have been proposed, but fail to incorporate human-centric considerations which are essential while developing assistive interfaces. In this work, we present a framework for incorporating LLMs as speech interfaces for physically assistive robots, constructed iteratively with 3 stages of testing involving a feeding robot, culminating in an evaluation with 11 older adults at an independent living facility. We use both quantitative and qualitative data from the final study to validate our framework and additionally provide design guidelines for using LLMs as speech interfaces for assistive robots. Videos and supporting files are located on our project website: https://sites.google.com/andrew.cmu.edu/voicepilot/ |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_04066 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots Padmanabha, Akhil Yuan, Jessie Gupta, Janavi Karachiwalla, Zulekha Majidi, Carmel Admoni, Henny Erickson, Zackory Robotics Computation and Language Human-Computer Interaction Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living. Speech interfaces, especially ones that utilize Large Language Models (LLMs), can enable individuals to effectively and naturally communicate high-level commands and nuanced preferences to robots. Frameworks for integrating LLMs as interfaces to robots for high level task planning and code generation have been proposed, but fail to incorporate human-centric considerations which are essential while developing assistive interfaces. In this work, we present a framework for incorporating LLMs as speech interfaces for physically assistive robots, constructed iteratively with 3 stages of testing involving a feeding robot, culminating in an evaluation with 11 older adults at an independent living facility. We use both quantitative and qualitative data from the final study to validate our framework and additionally provide design guidelines for using LLMs as speech interfaces for assistive robots. Videos and supporting files are located on our project website: https://sites.google.com/andrew.cmu.edu/voicepilot/ |
| title | VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots |
| topic | Robotics Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2404.04066 |