SonoHaptics: An Audio-Haptic Cursor for Gaze-Based Object Selection in XR
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913488365944832 |
|---|---|
| author | Cho, Hyunsung Sendhilnathan, Naveen Nebeling, Michael Wang, Tianyi Padmanabhan, Purnima Browder, Jonathan Lindlbauer, David Jonker, Tanya R. Todi, Kashyap |
| author_facet | Cho, Hyunsung Sendhilnathan, Naveen Nebeling, Michael Wang, Tianyi Padmanabhan, Purnima Browder, Jonathan Lindlbauer, David Jonker, Tanya R. Todi, Kashyap |
| contents | We introduce SonoHaptics, an audio-haptic cursor for gaze-based 3D object selection. SonoHaptics addresses challenges around providing accurate visual feedback during gaze-based selection in Extended Reality (XR), e.g., lack of world-locked displays in no- or limited-display smart glasses and visual inconsistencies. To enable users to distinguish objects without visual feedback, SonoHaptics employs the concept of cross-modal correspondence in human perception to map visual features of objects (color, size, position, material) to audio-haptic properties (pitch, amplitude, direction, timbre). We contribute data-driven models for determining cross-modal mappings of visual features to audio and haptic features, and a computational approach to automatically generate audio-haptic feedback for objects in the user's environment. SonoHaptics provides global feedback that is unique to each object in the scene, and local feedback to amplify differences between nearby objects. Our comparative evaluation shows that SonoHaptics enables accurate object identification and selection in a cluttered scene without visual feedback. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_00784 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SonoHaptics: An Audio-Haptic Cursor for Gaze-Based Object Selection in XR Cho, Hyunsung Sendhilnathan, Naveen Nebeling, Michael Wang, Tianyi Padmanabhan, Purnima Browder, Jonathan Lindlbauer, David Jonker, Tanya R. Todi, Kashyap Human-Computer Interaction H.5.1; H.5.2; H.5.5 We introduce SonoHaptics, an audio-haptic cursor for gaze-based 3D object selection. SonoHaptics addresses challenges around providing accurate visual feedback during gaze-based selection in Extended Reality (XR), e.g., lack of world-locked displays in no- or limited-display smart glasses and visual inconsistencies. To enable users to distinguish objects without visual feedback, SonoHaptics employs the concept of cross-modal correspondence in human perception to map visual features of objects (color, size, position, material) to audio-haptic properties (pitch, amplitude, direction, timbre). We contribute data-driven models for determining cross-modal mappings of visual features to audio and haptic features, and a computational approach to automatically generate audio-haptic feedback for objects in the user's environment. SonoHaptics provides global feedback that is unique to each object in the scene, and local feedback to amplify differences between nearby objects. Our comparative evaluation shows that SonoHaptics enables accurate object identification and selection in a cluttered scene without visual feedback. |
| title | SonoHaptics: An Audio-Haptic Cursor for Gaze-Based Object Selection in XR |
| topic | Human-Computer Interaction H.5.1; H.5.2; H.5.5 |
| url | https://arxiv.org/abs/2409.00784 |