How Can Large Language Models Enable Better Socially Assistive Human-Robot Interaction: A Brief Survey

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Shi, Zhonghao, Landrum, Ellen, Connell, Amy O', Kian, Mina, Pinto-Alva, Leticia, Shrestha, Kaleen, Zhu, Xiaoyuan, Matarić, Maja J
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917631260360704
author Shi, Zhonghao
Landrum, Ellen
Connell, Amy O'
Kian, Mina
Pinto-Alva, Leticia
Shrestha, Kaleen
Zhu, Xiaoyuan
Matarić, Maja J
author_facet Shi, Zhonghao
Landrum, Ellen
Connell, Amy O'
Kian, Mina
Pinto-Alva, Leticia
Shrestha, Kaleen
Zhu, Xiaoyuan
Matarić, Maja J
contents Socially assistive robots (SARs) have shown great success in providing personalized cognitive-affective support for user populations with special needs such as older adults, children with autism spectrum disorder (ASD), and individuals with mental health challenges. The large body of work on SAR demonstrates its potential to provide at-home support that complements clinic-based interventions delivered by mental health professionals, making these interventions more effective and accessible. However, there are still several major technical challenges that hinder SAR-mediated interactions and interventions from reaching human-level social intelligence and efficacy. With the recent advances in large language models (LLMs), there is an increased potential for novel applications within the field of SAR that can significantly expand the current capabilities of SARs. However, incorporating LLMs introduces new risks and ethical concerns that have not yet been encountered, and must be carefully be addressed to safely deploy these more advanced systems. In this work, we aim to conduct a brief survey on the use of LLMs in SAR technologies, and discuss the potentials and risks of applying LLMs to the following three major technical challenges of SAR: 1) natural language dialog; 2) multimodal understanding; 3) LLMs as robot policies.
format Preprint
id arxiv_https___arxiv_org_abs_2404_00938
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle How Can Large Language Models Enable Better Socially Assistive Human-Robot Interaction: A Brief Survey
Shi, Zhonghao
Landrum, Ellen
Connell, Amy O'
Kian, Mina
Pinto-Alva, Leticia
Shrestha, Kaleen
Zhu, Xiaoyuan
Matarić, Maja J
Human-Computer Interaction
Computation and Language
Computer Vision and Pattern Recognition
Robotics
Socially assistive robots (SARs) have shown great success in providing personalized cognitive-affective support for user populations with special needs such as older adults, children with autism spectrum disorder (ASD), and individuals with mental health challenges. The large body of work on SAR demonstrates its potential to provide at-home support that complements clinic-based interventions delivered by mental health professionals, making these interventions more effective and accessible. However, there are still several major technical challenges that hinder SAR-mediated interactions and interventions from reaching human-level social intelligence and efficacy. With the recent advances in large language models (LLMs), there is an increased potential for novel applications within the field of SAR that can significantly expand the current capabilities of SARs. However, incorporating LLMs introduces new risks and ethical concerns that have not yet been encountered, and must be carefully be addressed to safely deploy these more advanced systems. In this work, we aim to conduct a brief survey on the use of LLMs in SAR technologies, and discuss the potentials and risks of applying LLMs to the following three major technical challenges of SAR: 1) natural language dialog; 2) multimodal understanding; 3) LLMs as robot policies.
title How Can Large Language Models Enable Better Socially Assistive Human-Robot Interaction: A Brief Survey
topic Human-Computer Interaction
Computation and Language
Computer Vision and Pattern Recognition
Robotics
url https://arxiv.org/abs/2404.00938