Imitation of human motion achieves natural head movements for humanoid robots in an active-speaker detection task

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Ding, Bosong, Kirtay, Murat, Spigler, Giacomo
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911963447033856
author Ding, Bosong
Kirtay, Murat
Spigler, Giacomo
author_facet Ding, Bosong
Kirtay, Murat
Spigler, Giacomo
contents Head movements are crucial for social human-human interaction. They can transmit important cues (e.g., joint attention, speaker detection) that cannot be achieved with verbal interaction alone. This advantage also holds for human-robot interaction. Even though modeling human motions through generative AI models has become an active research area within robotics in recent years, the use of these methods for producing head movements in human-robot interaction remains underexplored. In this work, we employed a generative AI pipeline to produce human-like head movements for a Nao humanoid robot. In addition, we tested the system on a real-time active-speaker tracking task in a group conversation setting. Overall, the results show that the Nao robot successfully imitates human head movements in a natural manner while actively tracking the speakers during the conversation. Code and data from this study are available at https://github.com/dingdingding60/Humanoids2024HRI
format Preprint
id arxiv_https___arxiv_org_abs_2407_11915
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Imitation of human motion achieves natural head movements for humanoid robots in an active-speaker detection task
Ding, Bosong
Kirtay, Murat
Spigler, Giacomo
Robotics
Artificial Intelligence
Human-Computer Interaction
Machine Learning
Head movements are crucial for social human-human interaction. They can transmit important cues (e.g., joint attention, speaker detection) that cannot be achieved with verbal interaction alone. This advantage also holds for human-robot interaction. Even though modeling human motions through generative AI models has become an active research area within robotics in recent years, the use of these methods for producing head movements in human-robot interaction remains underexplored. In this work, we employed a generative AI pipeline to produce human-like head movements for a Nao humanoid robot. In addition, we tested the system on a real-time active-speaker tracking task in a group conversation setting. Overall, the results show that the Nao robot successfully imitates human head movements in a natural manner while actively tracking the speakers during the conversation. Code and data from this study are available at https://github.com/dingdingding60/Humanoids2024HRI
title Imitation of human motion achieves natural head movements for humanoid robots in an active-speaker detection task
topic Robotics
Artificial Intelligence
Human-Computer Interaction
Machine Learning
url https://arxiv.org/abs/2407.11915