From Human Hands to Robotic Limbs: A Study in Motor Skill Embodiment for Telemanipulation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shi, Haoyi, Su, Mingxi, Morris, Ted, Morellas, Vassilios, Papanikolopoulos, Nikolaos
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909474720055296
author Shi, Haoyi
Su, Mingxi
Morris, Ted
Morellas, Vassilios
Papanikolopoulos, Nikolaos
author_facet Shi, Haoyi
Su, Mingxi
Morris, Ted
Morellas, Vassilios
Papanikolopoulos, Nikolaos
contents This paper presents a teleoperation system for controlling a redundant degree of freedom robot manipulator using human arm gestures. We propose a GRU-based Variational Autoencoder to learn a latent representation of the manipulator's configuration space, capturing its complex joint kinematics. A fully connected neural network maps human arm configurations into this latent space, allowing the system to mimic and generate corresponding manipulator trajectories in real time through the VAE decoder. The proposed method shows promising results in teleoperating the manipulator, enabling the generation of novel manipulator configurations from human features that were not present during training.
format Preprint
id arxiv_https___arxiv_org_abs_2502_02036
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle From Human Hands to Robotic Limbs: A Study in Motor Skill Embodiment for Telemanipulation
Shi, Haoyi
Su, Mingxi
Morris, Ted
Morellas, Vassilios
Papanikolopoulos, Nikolaos
Robotics
Artificial Intelligence
This paper presents a teleoperation system for controlling a redundant degree of freedom robot manipulator using human arm gestures. We propose a GRU-based Variational Autoencoder to learn a latent representation of the manipulator's configuration space, capturing its complex joint kinematics. A fully connected neural network maps human arm configurations into this latent space, allowing the system to mimic and generate corresponding manipulator trajectories in real time through the VAE decoder. The proposed method shows promising results in teleoperating the manipulator, enabling the generation of novel manipulator configurations from human features that were not present during training.
title From Human Hands to Robotic Limbs: A Study in Motor Skill Embodiment for Telemanipulation
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2502.02036