Interactive Robot Programming for Surface Finishing via Task-Centric Mixed Reality Interfaces

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Willibald, Christoph, Martensen, Lugh, Eiband, Thomas, Lee, Dongheui
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915698660343808
author Willibald, Christoph
Martensen, Lugh
Eiband, Thomas
Lee, Dongheui
author_facet Willibald, Christoph
Martensen, Lugh
Eiband, Thomas
Lee, Dongheui
contents Lengthy setup processes that require robotics expertise remain a major barrier to deploying robots for tasks involving high product variability and small batch sizes. As a result, collaborative robots, despite their advanced sensing and control capabilities, are rarely used for surface finishing in small-scale craft and manufacturing settings. To address this gap, we propose a novel robot programming approach that enables non-experts to intuitively program robots through interactive, task-focused workflows. For that, we developed a new surface segmentation algorithm that incorporates human input to identify and refine workpiece regions for processing. Throughout the programming process, users receive continuous visual feedback on the robot's learned model, enabling them to iteratively refine the segmentation result. Based on the segmented surface model, a robot trajectory is generated to cover the desired processing area. We evaluated multiple interaction designs across two comprehensive user studies to derive an optimal interface that significantly reduces user workload, improves usability and enables effective task programming even for users with limited practical experience.
format Preprint
id arxiv_https___arxiv_org_abs_2512_23616
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Interactive Robot Programming for Surface Finishing via Task-Centric Mixed Reality Interfaces
Willibald, Christoph
Martensen, Lugh
Eiband, Thomas
Lee, Dongheui
Robotics
Lengthy setup processes that require robotics expertise remain a major barrier to deploying robots for tasks involving high product variability and small batch sizes. As a result, collaborative robots, despite their advanced sensing and control capabilities, are rarely used for surface finishing in small-scale craft and manufacturing settings. To address this gap, we propose a novel robot programming approach that enables non-experts to intuitively program robots through interactive, task-focused workflows. For that, we developed a new surface segmentation algorithm that incorporates human input to identify and refine workpiece regions for processing. Throughout the programming process, users receive continuous visual feedback on the robot's learned model, enabling them to iteratively refine the segmentation result. Based on the segmented surface model, a robot trajectory is generated to cover the desired processing area. We evaluated multiple interaction designs across two comprehensive user studies to derive an optimal interface that significantly reduces user workload, improves usability and enables effective task programming even for users with limited practical experience.
title Interactive Robot Programming for Surface Finishing via Task-Centric Mixed Reality Interfaces
topic Robotics
url https://arxiv.org/abs/2512.23616