Towards Multimodal Social Conversations with Robots: Using Vision-Language Models

Fuente: arXiv

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	Janssens, Ruben, Belpaeme, Tony
Format:	Preprint
Veröffentlicht:	2025
Schlagworte:	Robotics Computation and Language Human-Computer Interaction
Online-Zugang:	Acceder al recurso
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Ähnliche Einträge

Why Robots Are Bad at Detecting Their Mistakes: Limitations of Miscommunication Detection in Human-Robot Dialogue
von: Janssens, Ruben, et al.
Veröffentlicht: (2025)

Child Speech Recognition in Human-Robot Interaction: Problem Solved?
von: Janssens, Ruben, et al.
Veröffentlicht: (2024)

I Was Blind but Now I See: Implementing Vision-Enabled Dialogue in Social Robots
von: Abbo, Giulio Antonio, et al.
Veröffentlicht: (2023)

Concerns and Values in Human-Robot Interactions: A Focus on Social Robotics
von: Abbo, Giulio Antonio, et al.
Veröffentlicht: (2025)

Fast Multi-Party Open-Ended Conversation with a Social Robot
von: Abbo, Giulio Antonio, et al.
Veröffentlicht: (2025)

Situated Haptic Interaction: Exploring the Role of Context in Affective Perception of Robotic Touch
von: Ren, Qiaoqiao, et al.
Veröffentlicht: (2025)

"Can you be my mum?": Manipulating Social Robots in the Large Language Models Era
von: Abbo, Giulio Antonio, et al.
Veröffentlicht: (2025)

Empathic Grounding: Explorations using Multimodal Interaction and Large Language Models with Conversational Agents
von: Arjmand, Mehdi, et al.
Veröffentlicht: (2024)

If They Disagree, Will You Conform? Exploring the Role of Robots' Value Awareness in a Decision-Making Task
von: Pusceddu, Giulia, et al.
Veröffentlicht: (2025)

Robotic Backchanneling in Online Conversation Facilitation: A Cross-Generational Study
von: Kobuki, Sota, et al.
Veröffentlicht: (2024)

Agreeing to Interact in Human-Robot Interaction using Large Language Models and Vision Language Models
von: Sasabuchi, Kazuhiro, et al.
Veröffentlicht: (2025)

Vision Language Models as Values Detectors
von: Abbo, Giulio Antonio, et al.
Veröffentlicht: (2025)

Does the Appearance of Autonomous Conversational Robots Affect User Spoken Behaviors in Real-World Conference Interactions?
von: Pang, Zi Haur, et al.
Veröffentlicht: (2025)

Towards an LLM-Based Speech Interface for Robot-Assisted Feeding
von: Yuan, Jessie, et al.
Veröffentlicht: (2024)

Exploring LLM-generated Culture-specific Affective Human-Robot Tactile Interaction
von: Ren, Qiaoqiao, et al.
Veröffentlicht: (2025)

Robot Tasks with Fuzzy Time Requirements from Natural Language Instructions
von: Sucker, Sascha, et al.
Veröffentlicht: (2024)

Spoken Language Interaction with Robots: Research Issues and Recommendations, Report from the NSF Future Directions Workshop
von: Marge, Matthew, et al.
Veröffentlicht: (2020)

Large Language Models as Zero-Shot Human Models for Human-Robot Interaction
von: Zhang, Bowen, et al.
Veröffentlicht: (2023)

TalkWithMachines: Enhancing Human-Robot Interaction for Interpretable Industrial Robotics Through Large/Vision Language Models
von: Abbas, Ammar N., et al.
Veröffentlicht: (2024)

When Robots Say No: Temporal Trust Recovery Through Explanation
von: Webb, Nicola, et al.
Veröffentlicht: (2025)

VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots
von: Padmanabha, Akhil, et al.
Veröffentlicht: (2024)

Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation
von: Dai, Yinpei, et al.
Veröffentlicht: (2023)

A Framework for Adapting Human-Robot Interaction to Diverse User Groups
von: Rosin, Theresa Pekarek, et al.
Veröffentlicht: (2024)

Social Robots as Social Proxies for Fostering Connection and Empathy Towards Humanity
von: Shen, Jocelyn, et al.
Veröffentlicht: (2025)

Robust Understanding of Human-Robot Social Interactions through Multimodal Distillation
von: Bian, Tongfei, et al.
Veröffentlicht: (2025)

Interruption Handling for Conversational Robots
von: Cao, Shiye, et al.
Veröffentlicht: (2025)

The Conversation is the Command: Interacting with Real-World Autonomous Robot Through Natural Language
von: Nwankwo, Linus, et al.
Veröffentlicht: (2024)

How Can Large Language Models Enable Better Socially Assistive Human-Robot Interaction: A Brief Survey
von: Shi, Zhonghao, et al.
Veröffentlicht: (2024)

Towards a cognitive architecture to enable natural language interaction in co-constructive task learning
von: Scheibl, Manuel, et al.
Veröffentlicht: (2025)

Designing a Socially Assistive Robot to Support Older Adults with Low Vision
von: Zhou, Emily, et al.
Veröffentlicht: (2024)

Integrating Large Language Models with Multimodal Virtual Reality Interfaces to Support Collaborative Human-Robot Construction Work
von: Park, Somin, et al.
Veröffentlicht: (2024)

PERCY: Personal Emotional Robotic Conversational System
von: Meng, Zhijin, et al.
Veröffentlicht: (2025)

Enhancing Human-Robot Collaborative Assembly in Manufacturing Systems Using Large Language Models
von: Lim, Jonghan, et al.
Veröffentlicht: (2024)

Using the Pepper Robot to Support Sign Language Communication
von: Botta, Giulia, et al.
Veröffentlicht: (2025)

PISHYAR: A Socially Intelligent Smart Cane for Indoor Social Navigation and Multimodal Human-Robot Interaction for Visually Impaired People
von: Joo, Mahdi Haghighat, et al.
Veröffentlicht: (2026)

Multimodal Sensing and Machine Learning to Compare Printed and Verbal Assembly Instructions Delivered by a Social Robot
von: Mishra, Ruchik, et al.
Veröffentlicht: (2025)

Vision-Language System using Open-Source LLMs for Gestures in Medical Interpreter Robots
von: Ngo, Thanh-Tung, et al.
Veröffentlicht: (2026)

Using Design Metaphors to Understand User Expectations of Socially Interactive Robot Embodiments
von: Dennler, Nathaniel, et al.
Veröffentlicht: (2022)

The Design of Informative Take-Over Requests for Semi-Autonomous Cyber-Physical Systems: Combining Spoken Language and Visual Icons in a Drone-Controller Setting
von: Gundappa, Ashwini, et al.
Veröffentlicht: (2024)

Understanding Social Perception, Interactions, and Safety Aspects of Sidewalk Delivery Robots Using Sentiment Analysis
von: Du, Yuchen, et al.
Veröffentlicht: (2024)