Cover Image

A Multimodal Data Collection Framework for Dialogue-Driven Assistive Robotics to Clarify Ambiguities: A Wizard-of-Oz Pilot Study

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Liu, Guangping, Hawkins, Nicholas, Madden, Billy, Sultan, Tipu, Esposito, Flavio, Babaiasl, Madi
Format:	Preprint
Published:	2026
Subjects:	Robotics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Dialogue-Based Human-Robot Interaction Protocol for Wheelchair and Robotic Arm Integrated Control
by: Liu, Guangping, et al.
Published: (2026)

WheelArm-Sim: A Manipulation and Navigation Combined Multimodal Synthetic Data Generation Simulator for Unified Control in Assistive Robotics
by: Liu, Guangping, et al.
Published: (2026)

Improving Robotic Arms through Natural Language Processing, Computer Vision, and Edge Computing
by: Sikorski, Pascal, et al.
Published: (2024)

Deployment of Large Language Models to Control Mobile Robots at the Edge
by: Sikorski, Pascal, et al.
Published: (2024)

Achieving Interaction Fluidity in a Wizard-of-Oz Robotic System: A Prototype for Fluid Error-Correction
by: De Lima, Carlos Baptista, et al.
Published: (2026)

SRWToolkit: An Open Source Wizard of Oz Toolkit to Create Social Robotic Avatars
by: Nilgar, Atikkhan Faridkhan, et al.
Published: (2025)

Ask-to-Clarify: Resolving Instruction Ambiguity through Multi-turn Dialogue
by: Lin, Xingyao, et al.
Published: (2025)

Eye-tracking-Driven Shared Control for Robotic Arms: Wizard of Oz Studies to Assess Design Choices
by: Fischer-Janzen, Anke, et al.
Published: (2025)

Analysis and Detection of Differences in Spoken User Behaviors between Autonomous and Wizard-of-Oz Systems
by: Elmers, Mikey, et al.
Published: (2024)

STREAMS: An Assistive Multimodal AI Framework for Empowering Biosignal Based Robotic Controls
by: Rabiee, Ali, et al.
Published: (2024)

Resolving Positional Ambiguity in Dialogues by Vision-Language Models for Robot Navigation
by: Chen, Kuan-Lin, et al.
Published: (2024)

Demonstrating PilotAR: A Tool to Assist Wizard-of-Oz Pilot Studies with OHMD
by: Janaka, Nuwan, et al.
Published: (2024)

A Hybrid Controller Design for Human-Assistive Piloting of an Underactuated Blimp
by: Meng, Wugang, et al.
Published: (2024)

VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots
by: Padmanabha, Akhil, et al.
Published: (2024)

DRAGON: A Dialogue-Based Robot for Assistive Navigation with Visual Language Grounding
by: Liu, Shuijing, et al.
Published: (2023)

A Multi-Layer Sim-to-Real Framework for Gaze-Driven Assistive Neck Exoskeletons
by: Rubow, Colin, et al.
Published: (2026)

Unknown Object Grasping for Assistive Robotics
by: Miller, Elle, et al.
Published: (2024)

Cooperative Modular Manipulation with Numerous Cable-Driven Robots for Assistive Construction and Gap Crossing
by: Murphy, Kevin, et al.
Published: (2024)

Neuromuscular Modeling for Locomotion with Wearable Assistive Robots -- A primer
by: Refai, Mohamed Irfan, et al.
Published: (2024)

StretchBot: A Neuro-Symbolic Framework for Adaptive Guidance with Assistive Robots
by: Vogelgesang, Luca, et al.
Published: (2026)

A Human-In-The-Loop Simulation Framework for Evaluating Control Strategies in Gait Assistive Robots
by: Wang, Yifan, et al.
Published: (2025)

EHAZOP: A Proof of Concept Ethical Hazard Analysis of an Assistive Robot
by: Menon, Catherine, et al.
Published: (2024)

Zenbo Patrol: A Social Assistive Robot Based on Multimodal Deep Learning for Real-time Illegal Parking Recognition and Notification
by: Zheng, Jian-jie, et al.
Published: (2025)

The Sense of Agency in Assistive Robotics Using Shared Autonomy
by: Collier, Maggie A., et al.
Published: (2025)

SPARK: Safe Protective and Assistive Robot Kit
by: Sun, Yifan, et al.
Published: (2025)

On LLM Wizards: Identifying Large Language Models' Behaviors for Wizard of Oz Experiments
by: Fang, Jingchao, et al.
Published: (2024)

Tactile-Based Human Intent Recognition for Robot Assistive Navigation
by: Peng, Shaoting, et al.
Published: (2025)

Improving the performance of AI-powered Affordable Robotics for Assistive Tasks
by: Yugeswardeenoo, Dharunish
Published: (2025)

Assistive Soft Robotic Glove with Ruffles Enhanced Textile Actuators
by: Suulker, Cem, et al.
Published: (2024)

Investigating the Generalizability of Assistive Robots Models over Various Tasks
by: Osooli, Hamid, et al.
Published: (2024)

See Spot Guide: Accessible Interfaces for an Assistive Quadruped Robot
by: Hata, Rayna, et al.
Published: (2024)

SG-CoT: An Ambiguity-Aware Robotic Planning Framework using Scene Graph Representations
by: Rana, Akshat, et al.
Published: (2026)

A Personalizable Controller for the Walking Assistive omNi-Directional Exo-Robot (WANDER)
by: Fortuna, A., et al.
Published: (2024)

Socially Assistive Robots: A Technological Approach to Emotional Support
by: Yee, Leanne Oon Hui, et al.
Published: (2024)

Facilitating the Emergence of Assistive Robots to Support Frailty: Psychosocial and Environmental Realities
by: Higgins, Angela, et al.
Published: (2025)

Inclusion in Assistive Haircare Robotics: Practical and Ethical Considerations in Hair Manipulation
by: Yoo, Uksang, et al.
Published: (2024)

Learning Motion Skills with Adaptive Assistive Curriculum Force in Humanoid Robots
by: Cao, Zhanxiang, et al.
Published: (2025)

Design of Fuzzy Logic Parameter Tuners for Upper-Limb Assistive Robots
by: Coco Jr., Christopher, et al.
Published: (2024)

Users and Wizards in Conversations: How WoZ Interface Choices Define Human-Robot Interactions
by: Torubarova, Ekaterina, et al.
Published: (2026)

Compliant Control of Quadruped Robots for Assistive Load Carrying
by: Khandelwal, Nimesh, et al.
Published: (2025)