Cover Image

NatSGD: A Dataset with Speech, Gestures, and Demonstrations for Robot Learning in Natural Human-Robot Interaction

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Shrestha, Snehesh, Zha, Yantian, Banagiri, Saketh, Gao, Ge, Aloimonos, Yiannis, Fermuller, Cornelia
Format:	Preprint
Published:	2024
Subjects:	Robotics Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

NatSGLD: A Dataset with Speech, Gesture, Logic, and Demonstration for Robot Learning in Natural Human-Robot Interaction
by: Shrestha, Snehesh, et al.
Published: (2025)

Embodied Visuomotor Representation
by: Burner, Levi, et al.
Published: (2024)

Interactive-FAR:Interactive, Fast and Adaptable Routing for Navigation Among Movable Obstacles in Complex Unknown Environments
by: He, Botao, et al.
Published: (2024)

Air-FAR: Fast and Adaptable Routing for Aerial Navigation in Large-scale Complex Unknown Environments
by: He, Botao, et al.
Published: (2024)

ViewActive: Active viewpoint optimization from a single image
by: Wu, Jiayi, et al.
Published: (2024)

Active Human Pose Estimation via an Autonomous UAV Agent
by: Chen, Jingxi, et al.
Published: (2024)

MARVIS: Motion & Geometry Aware Real and Virtual Image Segmentation
by: Wu, Jiayi, et al.
Published: (2024)

Extremum Seeking Controlled Wiggling for Tactile Insertion
by: Burner, Levi, et al.
Published: (2024)

ControlTac: Force- and Position-Controlled Tactile Data Augmentation with a Single Reference Image
by: Luo, Dongyu, et al.
Published: (2025)

FeelAnyForce: Estimating Contact Force Feedback from Tactile Sensation for Vision-Based Tactile Sensors
by: Shahidzadeh, Amir-Hossein, et al.
Published: (2024)

Human-to-Robot Interaction: Learning from Video Demonstration for Robot Imitation
by: Canh, Thanh Nguyen, et al.
Published: (2026)

Diving Deep into the Motion Representation of Video-Text Models
by: Devaraj, Chinmaya, et al.
Published: (2024)

Maelstrom Networks
by: Evanusa, Matthew, et al.
Published: (2024)

Microsaccade-inspired Event Camera for Robotics
by: He, Botao, et al.
Published: (2024)

Speech-Gesture Mapping and Engagement Evaluation in Human Robot Interaction
by: Ghosh, Bishal, et al.
Published: (2018)

Choreographing the Digital Canvas: A Machine Learning Approach to Artistic Performance
by: Peng, Siyuan, et al.
Published: (2024)

EmbodiSwap for Zero-Shot Robot Imitation Learning
by: Dessalene, Eadom, et al.
Published: (2025)

AcTExplore: Active Tactile Exploration of Unknown Objects
by: Shahidzadeh, Amir-Hossein, et al.
Published: (2023)

Object Pose Estimation through Dexterous Touch
by: Shahidzadeh, Amir-Hossein, et al.
Published: (2025)

HumanEgo: Zero-Shot Robot Learning from Minutes of Human Egocentric Videos
by: Wang, Zhi, et al.
Published: (2026)

NavMoE: Hybrid Model- and Learning-based Traversability Estimation for Local Navigation via Mixture of Experts
by: He, Botao, et al.
Published: (2025)

Gesture Controlled Robot For Human Detection
by: S, Athira T., et al.
Published: (2024)

Towards Senior-Robot Interaction: Reactive Robot Dog Gestures
by: Meng, Chunyang, et al.
Published: (2025)

VioPose: Violin Performance 4D Pose Estimation by Hierarchical Audiovisual Inference
by: Yoo, Seong Jong, et al.
Published: (2024)

Decodable and Sample Invariant Continuous Object Encoder
by: Yuan, Dehao, et al.
Published: (2023)

Cook2LTL: Translating Cooking Recipes to LTL Formulae using Large Language Models
by: Mavrogiannis, Angelos, et al.
Published: (2023)

Discovering Object Attributes by Prompting Large Language Models with Perception-Action APIs
by: Mavrogiannis, Angelos, et al.
Published: (2024)

FR-GESTURE: An RGBD Dataset For Gesture-based Human-Robot Interaction In First Responder Operations
by: Foteinos, Konstantinos, et al.
Published: (2026)

Unified Learning from Demonstrations, Corrections, and Preferences during Physical Human-Robot Interaction
by: Mehta, Shaunak A., et al.
Published: (2022)

Advancements in Gesture Recognition Techniques and Machine Learning for Enhanced Human-Robot Interaction: A Comprehensive Review
by: Hussain, Sajjad, et al.
Published: (2024)

Gesture-Controlled Aerial Robot Formation for Human-Swarm Interaction in Safety Monitoring Applications
by: Krátký, Vít, et al.
Published: (2024)

On the Design of Human-Robot Collaboration Gestures
by: Shrinah, Anas, et al.
Published: (2024)

ChatSim: Underwater Simulation with Natural Language Prompting
by: Palnitkar, Aadi, et al.
Published: (2023)

Human Demonstrations are Generalizable Knowledge for Robots
by: Cui, Te, et al.
Published: (2023)

Teaching Robots Like Dogs: Learning Agile Navigation from Luring, Gesture, and Speech
by: Yoon, Taerim, et al.
Published: (2026)

Speech-Gesture GAN: Gesture Generation for Robots and Embodied Agents
by: Liu, Carson Yu, et al.
Published: (2023)

Kaiwu: A Multimodal Manipulation Dataset and Framework for Robot Learning and Human-Robot Interaction
by: Jiang, Shuo, et al.
Published: (2025)

Active Robot Curriculum Learning from Online Human Demonstrations
by: Hou, Muhan, et al.
Published: (2025)

Influence of Gripper Design on Human Demonstration Quality for Robot Learning
by: Georgadarellis, Gina L., et al.
Published: (2026)

Human-Like Robot Impedance Regulation Skill Learning from Human-Human Demonstrations
by: Li, Chenzui, et al.
Published: (2025)