Saved in:
Bibliographic Details
Main Authors: Werner, Alexander, Melek, William
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2405.07128
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • This paper presents an approach to teleoperate a manipulator using a mobile phone as a leader device. Using its IMU and camera, the phone estimates its Cartesian pose which is then used to to control the Cartesian pose of the robot's tool. The user receives visual feedback in the form of multi-view video - a point cloud rendered in a virtual reality environment. This enables the user to observe the scene from any position. To increase immersion, the robot's estimate of external forces is relayed using the phone's haptic actuator. Leader and follower are connected through wireless networks such as 5G or Wi-Fi. The paper describes the setup and analyzes its performance.