Head Orientation Estimation with Distributed Microphones Using Speech Radiation Patterns
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866911432422981632 |
|---|---|
| author | Müller, Kaspar Çakmak, Bilgesu Didier, Paul Doclo, Simon Østergaard, Jan Wolff, Tobias |
| author_facet | Müller, Kaspar Çakmak, Bilgesu Didier, Paul Doclo, Simon Østergaard, Jan Wolff, Tobias |
| contents | Determining the head orientation of a talker is not only beneficial for various speech signal processing applications, such as source localization or speech enhancement, but also facilitates intuitive voice control and interaction with smart environments or modern car assistants. Most approaches for head orientation estimation are based on visual cues. However, this requires camera systems which often are not available. We present an approach which purely uses audio signals captured with only a few distributed microphones around the talker. Specifically, we propose a novel method that directly incorporates measured or modeled speech radiation patterns to infer the talker's orientation during active speech periods based on a cosine similarity measure. Moreover, an automatic gain adjustment technique is proposed for uncalibrated, irregular microphone setups, such as ad-hoc sensor networks. In experiments with signals recorded in both anechoic and reverberant environments, the proposed method outperforms state-of-the-art approaches, using either measured or modeled speech radiation patterns. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2312_01808 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Head Orientation Estimation with Distributed Microphones Using Speech Radiation Patterns Müller, Kaspar Çakmak, Bilgesu Didier, Paul Doclo, Simon Østergaard, Jan Wolff, Tobias Audio and Speech Processing Sound Determining the head orientation of a talker is not only beneficial for various speech signal processing applications, such as source localization or speech enhancement, but also facilitates intuitive voice control and interaction with smart environments or modern car assistants. Most approaches for head orientation estimation are based on visual cues. However, this requires camera systems which often are not available. We present an approach which purely uses audio signals captured with only a few distributed microphones around the talker. Specifically, we propose a novel method that directly incorporates measured or modeled speech radiation patterns to infer the talker's orientation during active speech periods based on a cosine similarity measure. Moreover, an automatic gain adjustment technique is proposed for uncalibrated, irregular microphone setups, such as ad-hoc sensor networks. In experiments with signals recorded in both anechoic and reverberant environments, the proposed method outperforms state-of-the-art approaches, using either measured or modeled speech radiation patterns. |
| title | Head Orientation Estimation with Distributed Microphones Using Speech Radiation Patterns |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2312.01808 |