Cover Image

Vision-Language System using Open-Source LLMs for Gestures in Medical Interpreter Robots

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ngo, Thanh-Tung, Murphy, Emma, Ross, Robert J.
Format:	Preprint
Published:	2026
Subjects:	Robotics Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Towards Human Haptic Gesture Interpretation for Robotic Systems
by: Bianchini, Bibit, et al.
Published: (2020)

On the Design of Human-Robot Collaboration Gestures
by: Shrinah, Anas, et al.
Published: (2024)

In the Arms of a Robot: Designing Autonomous Hugging Robots with Intra-Hug Gestures
by: Block, Alexis E., et al.
Published: (2022)

An Open-Source Reproducible Chess Robot for Human-Robot Interaction Research
by: Zhang, Renchi, et al.
Published: (2024)

Hands-On Robotics: Enabling Communication Through Direct Gesture Control
by: Pascher, Max, et al.
Published: (2024)

Speech-Gesture Mapping and Engagement Evaluation in Human Robot Interaction
by: Ghosh, Bishal, et al.
Published: (2018)

Walk along: An Experiment on Controlling the Mobile Robot 'Spot' with Voice and Gestures
by: Zhang, Renchi, et al.
Published: (2024)

Toward Process Controlled Medical Robotic System
by: Liu, Yihao, et al.
Published: (2023)

SRWToolkit: An Open Source Wizard of Oz Toolkit to Create Social Robotic Avatars
by: Nilgar, Atikkhan Faridkhan, et al.
Published: (2025)

Eliciting Understandable Architectonic Gestures for Robotic Furniture through Co-Design Improvisation
by: Nguyen, Alex Binh Vinh Duc, et al.
Published: (2025)

Intuitive Human-Robot Interaction: Development and Evaluation of a Gesture-Based User Interface for Object Selection
by: Kavousian, Bijan, et al.
Published: (2026)

SlicerRoboTMS: An Open-Source 3D Slicer Extension for Robot-Assisted Transcranial Magnetic Stimulation
by: Bai, Wenzhi, et al.
Published: (2026)

LEGS-POMDP: Language and Gesture-Guided Object Search in Partially Observable Environments
by: He, Ivy Xiao, et al.
Published: (2026)

Enabling Waypoint Generation for Collaborative Robots using LLMs and Mixed Reality
by: Fang, Cathy Mengying, et al.
Published: (2024)

Xpress: A System For Dynamic, Context-Aware Robot Facial Expressions using Language Models
by: Antony, Victor Nikhil, et al.
Published: (2025)

Evaluating Gesture Recognition in Virtual Reality
by: Sabbella, Sandeep Reddy, et al.
Published: (2024)

Gesture First, LLM-Assisted Voice Complement: Exploring Multimodal Robot 'Puppeteer' Teleoperation Via Virtual Counterpart in Augmented Reality
by: Zhang, Yuchong, et al.
Published: (2025)

Interactive Multi-Robot Flocking with Gesture Responsiveness and Musical Accompaniment
by: Cuan, Catie, et al.
Published: (2024)

Indicating Robot Vision Capabilities with Augmented Reality
by: Wang, Hong, et al.
Published: (2025)

ERUPT: An Open Toolkit for Interfacing with Robot Motion Planners in Extended Reality
by: Ngui, Isaac, et al.
Published: (2025)

AI or Human? Understanding Perceptions of Embodied Robots with LLMs
by: Hriscu, Lavinia, et al.
Published: (2025)

Camera Frame Misalignment in a Teleoperated Eye-in-Hand Robot: Effects and a Simple Correction Method
by: Wu, Liao, et al.
Published: (2021)

Quadrupped-Legged Robot Movement Plan Generation using Large Language Model
by: Muhtadin, et al.
Published: (2025)

Designing a Socially Assistive Robot to Support Older Adults with Low Vision
by: Zhou, Emily, et al.
Published: (2024)

Theatre in the Loop: A Rehearsal-Based, Collaborative Workflow for Expressive Robotic Behaviours
by: Panagiotidis, Pavlos, et al.
Published: (2025)

MRDrive: An Open Source Mixed Reality Driving Simulator for Automotive User Research
by: Ebel, Patrick, et al.
Published: (2026)

Designing Multispecies Worlds for Robots, Cats, and Humans
by: Schneiders, Eike, et al.
Published: (2024)

Enhancing Human-Robot Collaborative Assembly in Manufacturing Systems Using Large Language Models
by: Lim, Jonghan, et al.
Published: (2024)

End-User Development for Human-Robot Interaction
by: Stegner, Laura, et al.
Published: (2024)

Teaching Robots to Interpret Social Interactions through Lexically-guided Dynamic Graph Learning
by: Bian, Tongfei, et al.
Published: (2026)

Fast Multi-Party Open-Ended Conversation with a Social Robot
by: Abbo, Giulio Antonio, et al.
Published: (2025)

Towards Multimodal Social Conversations with Robots: Using Vision-Language Models
by: Janssens, Ruben, et al.
Published: (2025)

Defining and Monitoring Complex Robot Activities via LLMs and Symbolic Reasoning
by: Argenziano, Francesco, et al.
Published: (2025)

TransforMerger: Transformer-based Voice-Gesture Fusion for Robust Human-Robot Communication
by: Vanc, Petr, et al.
Published: (2025)

ROSClaw: An OpenClaw ROS 2 Framework for Agentic Robot Control and Interaction
by: Cardenas, Irvin Steve, et al.
Published: (2026)

SemanticScanpath: Combining Gaze and Speech for Situated Human-Robot Interaction Using LLMs
by: Menendez, Elisabeth, et al.
Published: (2025)

Mind Meets Robots: A Review of EEG-Based Brain-Robot Interaction Systems
by: Zhang, Yuchong, et al.
Published: (2024)

PERCY: Personal Emotional Robotic Conversational System
by: Meng, Zhijin, et al.
Published: (2025)

Don't Yell at Your Robot: Physical Correction as the Collaborative Interface for Language Model Powered Robots
by: Zhang, Chuye, et al.
Published: (2024)

Text to Robotic Assembly of Multi Component Objects using 3D Generative AI and Vision Language Models
by: Kyaw, Alexander Htet, et al.
Published: (2025)