Auptimize: Optimal Placement of Spatial Audio Cues for Extended Reality
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866910569519382528 |
|---|---|
| author | Cho, Hyunsung Wang, Alexander Kartik, Divya Xie, Emily Liying Yan, Yukang Lindlbauer, David |
| author_facet | Cho, Hyunsung Wang, Alexander Kartik, Divya Xie, Emily Liying Yan, Yukang Lindlbauer, David |
| contents | Spatial audio in Extended Reality (XR) provides users with better awareness of where virtual elements are placed, and efficiently guides them to events such as notifications, system alerts from different windows, or approaching avatars. Humans, however, are inaccurate in localizing sound cues, especially with multiple sources due to limitations in human auditory perception such as angular discrimination error and front-back confusion. This decreases the efficiency of XR interfaces because users misidentify from which XR element a sound is coming. To address this, we propose Auptimize, a novel computational approach for placing XR sound sources, which mitigates such localization errors by utilizing the ventriloquist effect. Auptimize disentangles the sound source locations from the visual elements and relocates the sound sources to optimal positions for unambiguous identification of sound cues, avoiding errors due to inter-source proximity and front-back confusion. Our evaluation shows that Auptimize decreases spatial audio-based source identification errors compared to playing sound cues at the paired visual-sound locations. We demonstrate the applicability of Auptimize for diverse spatial audio-based interactive XR scenarios. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2408_09320 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Auptimize: Optimal Placement of Spatial Audio Cues for Extended Reality Cho, Hyunsung Wang, Alexander Kartik, Divya Xie, Emily Liying Yan, Yukang Lindlbauer, David Human-Computer Interaction Sound Audio and Speech Processing H.5.1; H.5.2; H.5.5 Spatial audio in Extended Reality (XR) provides users with better awareness of where virtual elements are placed, and efficiently guides them to events such as notifications, system alerts from different windows, or approaching avatars. Humans, however, are inaccurate in localizing sound cues, especially with multiple sources due to limitations in human auditory perception such as angular discrimination error and front-back confusion. This decreases the efficiency of XR interfaces because users misidentify from which XR element a sound is coming. To address this, we propose Auptimize, a novel computational approach for placing XR sound sources, which mitigates such localization errors by utilizing the ventriloquist effect. Auptimize disentangles the sound source locations from the visual elements and relocates the sound sources to optimal positions for unambiguous identification of sound cues, avoiding errors due to inter-source proximity and front-back confusion. Our evaluation shows that Auptimize decreases spatial audio-based source identification errors compared to playing sound cues at the paired visual-sound locations. We demonstrate the applicability of Auptimize for diverse spatial audio-based interactive XR scenarios. |
| title | Auptimize: Optimal Placement of Spatial Audio Cues for Extended Reality |
| topic | Human-Computer Interaction Sound Audio and Speech Processing H.5.1; H.5.2; H.5.5 |
| url | https://arxiv.org/abs/2408.09320 |