Human-mimetic binaural ear design and sound source direction estimation for task realization of musculoskeletal humanoids

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Omura, Yusuke, Kawaharazuka, Kento, Nagamatsu, Yuya, Koga, Yuya, Nishiura, Manabu, Toshimitsu, Yasunori, Asano, Yuki, Okada, Kei, Kawasaki, Koji, Inaba, Masayuki
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917772376670208
author Omura, Yusuke
Kawaharazuka, Kento
Nagamatsu, Yuya
Koga, Yuya
Nishiura, Manabu
Toshimitsu, Yasunori
Asano, Yuki
Okada, Kei
Kawasaki, Koji
Inaba, Masayuki
author_facet Omura, Yusuke
Kawaharazuka, Kento
Nagamatsu, Yuya
Koga, Yuya
Nishiura, Manabu
Toshimitsu, Yasunori
Asano, Yuki
Okada, Kei
Kawasaki, Koji
Inaba, Masayuki
contents Human-like environment recognition by musculoskeletal humanoids is important for task realization in real complex environments and for use as dummies for test subjects. Humans integrate various sensory information to perceive their surroundings, and hearing is particularly useful for recognizing objects out of view or out of touch. In this research, we aim to realize human-like auditory environmental recognition and task realization for musculoskeletal humanoids by equipping them with a human-like auditory processing system. Humans realize sound-based environmental recognition by estimating directions of the sound sources and detecting environmental sounds based on changes in the time and frequency domain of incoming sounds and the integration of auditory information in the central nervous system. We propose a human mimetic auditory information processing system, which consists of three components: the human mimetic binaural ear unit, which mimics human ear structure and characteristics, the sound source direction estimation system, and the environmental sound detection system, which mimics processing in the central nervous system. We apply it to Musashi, a human mimetic musculoskeletal humanoid, and have it perform tasks that require sound information outside of view in real noisy environments to confirm the usefulness of the proposed methods.
format Preprint
id arxiv_https___arxiv_org_abs_2409_06429
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Human-mimetic binaural ear design and sound source direction estimation for task realization of musculoskeletal humanoids
Omura, Yusuke
Kawaharazuka, Kento
Nagamatsu, Yuya
Koga, Yuya
Nishiura, Manabu
Toshimitsu, Yasunori
Asano, Yuki
Okada, Kei
Kawasaki, Koji
Inaba, Masayuki
Robotics
Sound
Audio and Speech Processing
Human-like environment recognition by musculoskeletal humanoids is important for task realization in real complex environments and for use as dummies for test subjects. Humans integrate various sensory information to perceive their surroundings, and hearing is particularly useful for recognizing objects out of view or out of touch. In this research, we aim to realize human-like auditory environmental recognition and task realization for musculoskeletal humanoids by equipping them with a human-like auditory processing system. Humans realize sound-based environmental recognition by estimating directions of the sound sources and detecting environmental sounds based on changes in the time and frequency domain of incoming sounds and the integration of auditory information in the central nervous system. We propose a human mimetic auditory information processing system, which consists of three components: the human mimetic binaural ear unit, which mimics human ear structure and characteristics, the sound source direction estimation system, and the environmental sound detection system, which mimics processing in the central nervous system. We apply it to Musashi, a human mimetic musculoskeletal humanoid, and have it perform tasks that require sound information outside of view in real noisy environments to confirm the usefulness of the proposed methods.
title Human-mimetic binaural ear design and sound source direction estimation for task realization of musculoskeletal humanoids
topic Robotics
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2409.06429