Observer Design for Augmented Reality-based Teleoperation of Soft Robots

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: García-Samartín, Jorge Francisco, Pérez, Iago López, Yolcu, Emirhan, del Cerro, Jaime, Barrientos, Antonio
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915837034627072
author García-Samartín, Jorge Francisco
Pérez, Iago López
Yolcu, Emirhan
del Cerro, Jaime
Barrientos, Antonio
author_facet García-Samartín, Jorge Francisco
Pérez, Iago López
Yolcu, Emirhan
del Cerro, Jaime
Barrientos, Antonio
contents Although virtual and augmented reality are gaining traction as teleoperation tools for various types of robots, including manipulators and mobile robots, they are not being used for soft robots. The inherent difficulties of modelling soft robots mean that combining accurate and computationally efficient representations is very challenging. This paper presents an augmented reality interface for teleoperating these devices. The developed system consists of Microsoft HoloLens 2 glasses and a central computer responsible for calculations. Validation is performed on PETER, a highly modular pneumatic manipulator. Using data collected from sensors, the computer estimates the robot's position based on the physics of the virtual reality programme. Errors obtained are on the order of 5% of the robot's length, demonstrating that augmented reality facilitates operator interaction with soft manipulators and can be integrated into the control loop.
format Preprint
id arxiv_https___arxiv_org_abs_2603_05015
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Observer Design for Augmented Reality-based Teleoperation of Soft Robots
García-Samartín, Jorge Francisco
Pérez, Iago López
Yolcu, Emirhan
del Cerro, Jaime
Barrientos, Antonio
Robotics
Although virtual and augmented reality are gaining traction as teleoperation tools for various types of robots, including manipulators and mobile robots, they are not being used for soft robots. The inherent difficulties of modelling soft robots mean that combining accurate and computationally efficient representations is very challenging. This paper presents an augmented reality interface for teleoperating these devices. The developed system consists of Microsoft HoloLens 2 glasses and a central computer responsible for calculations. Validation is performed on PETER, a highly modular pneumatic manipulator. Using data collected from sensors, the computer estimates the robot's position based on the physics of the virtual reality programme. Errors obtained are on the order of 5% of the robot's length, demonstrating that augmented reality facilitates operator interaction with soft manipulators and can be integrated into the control loop.
title Observer Design for Augmented Reality-based Teleoperation of Soft Robots
topic Robotics
url https://arxiv.org/abs/2603.05015