Multi-Class Human/Object Detection on Robot Manipulators using Proprioceptive Sensing

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hehli, Justin, Heiniger, Marco, Rezayati, Maryam, van de Venn, Hans Wernher
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912518725697536
author Hehli, Justin
Heiniger, Marco
Rezayati, Maryam
van de Venn, Hans Wernher
author_facet Hehli, Justin
Heiniger, Marco
Rezayati, Maryam
van de Venn, Hans Wernher
contents In physical human-robot collaboration (pHRC) settings, humans and robots collaborate directly in shared environments. Robots must analyze interactions with objects to ensure safety and facilitate meaningful workflows. One critical aspect is human/object detection, where the contacted object is identified. Past research introduced binary machine learning classifiers to distinguish between soft and hard objects. This study improves upon those results by evaluating three-class human/object detection models, offering more detailed contact analysis. A dataset was collected using the Franka Emika Panda robot manipulator, exploring preprocessing strategies for time-series analysis. Models including LSTM, GRU, and Transformers were trained on these datasets. The best-performing model achieved 91.11\% accuracy during real-time testing, demonstrating the feasibility of multi-class detection models. Additionally, a comparison of preprocessing strategies suggests a sliding window approach is optimal for this task.
format Preprint
id arxiv_https___arxiv_org_abs_2508_02425
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multi-Class Human/Object Detection on Robot Manipulators using Proprioceptive Sensing
Hehli, Justin
Heiniger, Marco
Rezayati, Maryam
van de Venn, Hans Wernher
Robotics
Artificial Intelligence
In physical human-robot collaboration (pHRC) settings, humans and robots collaborate directly in shared environments. Robots must analyze interactions with objects to ensure safety and facilitate meaningful workflows. One critical aspect is human/object detection, where the contacted object is identified. Past research introduced binary machine learning classifiers to distinguish between soft and hard objects. This study improves upon those results by evaluating three-class human/object detection models, offering more detailed contact analysis. A dataset was collected using the Franka Emika Panda robot manipulator, exploring preprocessing strategies for time-series analysis. Models including LSTM, GRU, and Transformers were trained on these datasets. The best-performing model achieved 91.11\% accuracy during real-time testing, demonstrating the feasibility of multi-class detection models. Additionally, a comparison of preprocessing strategies suggests a sliding window approach is optimal for this task.
title Multi-Class Human/Object Detection on Robot Manipulators using Proprioceptive Sensing
topic Robotics
Artificial Intelligence
url https://arxiv.org/abs/2508.02425