Towards an LLM-Based Speech Interface for Robot-Assisted Feeding
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914993091379200 |
|---|---|
| author | Yuan, Jessie Gupta, Janavi Padmanabha, Akhil Karachiwalla, Zulekha Majidi, Carmel Admoni, Henny Erickson, Zackory |
| author_facet | Yuan, Jessie Gupta, Janavi Padmanabha, Akhil Karachiwalla, Zulekha Majidi, Carmel Admoni, Henny Erickson, Zackory |
| contents | Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living (ADLs). Speech interfaces, especially ones that utilize Large Language Models (LLMs), can enable individuals to effectively and naturally communicate high-level commands and nuanced preferences to robots. In this work, we demonstrate an LLM-based speech interface for a commercially available assistive feeding robot. Our system is based on an iteratively designed framework, from the paper "VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots," that incorporates human-centric elements for integrating LLMs as interfaces for robots. It has been evaluated through a user study with 11 older adults at an independent living facility. Videos are located on our project website: https://sites.google.com/andrew.cmu.edu/voicepilot/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_20624 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards an LLM-Based Speech Interface for Robot-Assisted Feeding Yuan, Jessie Gupta, Janavi Padmanabha, Akhil Karachiwalla, Zulekha Majidi, Carmel Admoni, Henny Erickson, Zackory Robotics Computation and Language Human-Computer Interaction Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living (ADLs). Speech interfaces, especially ones that utilize Large Language Models (LLMs), can enable individuals to effectively and naturally communicate high-level commands and nuanced preferences to robots. In this work, we demonstrate an LLM-based speech interface for a commercially available assistive feeding robot. Our system is based on an iteratively designed framework, from the paper "VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots," that incorporates human-centric elements for integrating LLMs as interfaces for robots. It has been evaluated through a user study with 11 older adults at an independent living facility. Videos are located on our project website: https://sites.google.com/andrew.cmu.edu/voicepilot/. |
| title | Towards an LLM-Based Speech Interface for Robot-Assisted Feeding |
| topic | Robotics Computation and Language Human-Computer Interaction |
| url | https://arxiv.org/abs/2410.20624 |