Autonomous Human-Robot Interaction via Operator Imitation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915226124812288 |
|---|---|
| author | Christen, Sammy Müller, David Serifi, Agon Grandia, Ruben Wiedebach, Georg Hopkins, Michael A. Knoop, Espen Bächer, Moritz |
| author_facet | Christen, Sammy Müller, David Serifi, Agon Grandia, Ruben Wiedebach, Georg Hopkins, Michael A. Knoop, Espen Bächer, Moritz |
| contents | Teleoperated robotic characters can perform expressive interactions with humans, relying on the operators' experience and social intuition. In this work, we propose to create autonomous interactive robots, by training a model to imitate operator data. Our model is trained on a dataset of human-robot interactions, where an expert operator is asked to vary the interactions and mood of the robot, while the operator commands as well as the pose of the human and robot are recorded. Our approach learns to predict continuous operator commands through a diffusion process and discrete commands through a classifier, all unified within a single transformer architecture. We evaluate the resulting model in simulation and with a user study on the real system. We show that our method enables simple autonomous human-robot interactions that are comparable to the expert-operator baseline, and that users can recognize the different robot moods as generated by our model. Finally, we demonstrate a zero-shot transfer of our model onto a different robotic platform with the same operator interface. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_02724 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Autonomous Human-Robot Interaction via Operator Imitation Christen, Sammy Müller, David Serifi, Agon Grandia, Ruben Wiedebach, Georg Hopkins, Michael A. Knoop, Espen Bächer, Moritz Robotics Artificial Intelligence Teleoperated robotic characters can perform expressive interactions with humans, relying on the operators' experience and social intuition. In this work, we propose to create autonomous interactive robots, by training a model to imitate operator data. Our model is trained on a dataset of human-robot interactions, where an expert operator is asked to vary the interactions and mood of the robot, while the operator commands as well as the pose of the human and robot are recorded. Our approach learns to predict continuous operator commands through a diffusion process and discrete commands through a classifier, all unified within a single transformer architecture. We evaluate the resulting model in simulation and with a user study on the real system. We show that our method enables simple autonomous human-robot interactions that are comparable to the expert-operator baseline, and that users can recognize the different robot moods as generated by our model. Finally, we demonstrate a zero-shot transfer of our model onto a different robotic platform with the same operator interface. |
| title | Autonomous Human-Robot Interaction via Operator Imitation |
| topic | Robotics Artificial Intelligence |
| url | https://arxiv.org/abs/2504.02724 |