Sketch Interface for Teleoperation of Mobile Manipulator to Enable Intuitive and Intended Operation: A Proof of Concept

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Iwanaga, Yuka, Tsuchinaga, Masayoshi, Tanada, Kosei, Nakamura, Yuji, Mori, Takemitsu, Yamamoto, Takashi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915295483920384
author Iwanaga, Yuka
Tsuchinaga, Masayoshi
Tanada, Kosei
Nakamura, Yuji
Mori, Takemitsu
Yamamoto, Takashi
author_facet Iwanaga, Yuka
Tsuchinaga, Masayoshi
Tanada, Kosei
Nakamura, Yuji
Mori, Takemitsu
Yamamoto, Takashi
contents Recent advancements in robotics have underscored the need for effective collaboration between humans and robots. Traditional interfaces often struggle to balance robot autonomy with human oversight, limiting their practical application in complex tasks like mobile manipulation. This study aims to develop an intuitive interface that enables a mobile manipulator to autonomously interpret user-provided sketches, enhancing user experience while minimizing burden. We implemented a web-based application utilizing machine learning algorithms to process sketches, making the interface accessible on mobile devices for use anytime, anywhere, by anyone. In the first validation, we examined natural sketches drawn by users for 27 selected manipulation and navigation tasks, gaining insights into trends related to sketch instructions. The second validation involved comparative experiments with five grasping tasks, showing that the sketch interface reduces workload and enhances intuitiveness compared to conventional axis control interfaces. These findings suggest that the proposed sketch interface improves the efficiency of mobile manipulators and opens new avenues for integrating intuitive human-robot collaboration in various applications.
format Preprint
id arxiv_https___arxiv_org_abs_2505_13931
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sketch Interface for Teleoperation of Mobile Manipulator to Enable Intuitive and Intended Operation: A Proof of Concept
Iwanaga, Yuka
Tsuchinaga, Masayoshi
Tanada, Kosei
Nakamura, Yuji
Mori, Takemitsu
Yamamoto, Takashi
Robotics
Human-Computer Interaction
Recent advancements in robotics have underscored the need for effective collaboration between humans and robots. Traditional interfaces often struggle to balance robot autonomy with human oversight, limiting their practical application in complex tasks like mobile manipulation. This study aims to develop an intuitive interface that enables a mobile manipulator to autonomously interpret user-provided sketches, enhancing user experience while minimizing burden. We implemented a web-based application utilizing machine learning algorithms to process sketches, making the interface accessible on mobile devices for use anytime, anywhere, by anyone. In the first validation, we examined natural sketches drawn by users for 27 selected manipulation and navigation tasks, gaining insights into trends related to sketch instructions. The second validation involved comparative experiments with five grasping tasks, showing that the sketch interface reduces workload and enhances intuitiveness compared to conventional axis control interfaces. These findings suggest that the proposed sketch interface improves the efficiency of mobile manipulators and opens new avenues for integrating intuitive human-robot collaboration in various applications.
title Sketch Interface for Teleoperation of Mobile Manipulator to Enable Intuitive and Intended Operation: A Proof of Concept
topic Robotics
Human-Computer Interaction
url https://arxiv.org/abs/2505.13931