Feelings, Not Feel: Affective Audio-Visual Pseudo-Haptics in Hand-Tracked XR
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866915821850198016 |
|---|---|
| author | David, Kristian Paolo Maria, Tyrone Justin Sta Gamboa, Mikkel Dominic Deja, Jordan Aiko |
| author_facet | David, Kristian Paolo Maria, Tyrone Justin Sta Gamboa, Mikkel Dominic Deja, Jordan Aiko |
| contents | Hand-tracking enables controller-free XR interaction but does not have the tactile feedback controllers provide. Rather than treating this solely as a missing-sensation problem, we explore whether pseudo-haptic cues on an embodied virtual hand act as tactile or as affect substitutes that shape how interactions feel. We used a mixed reality prototype that keeps the contacted surface visually neutral, rendering cues on the hand with motion modulation for texture, color glow, and movement-coupled sound. In a within-subjects study (n=12), participants experienced 12 conditions (4 effects x 3 modalities: audio, visual, both) and reported subjective affect and cognitive demand. Participants rarely reported sustained tactile, thermal sensations, yet affect shifted systematically: rough-hot lowered valence increasing arousal, while smooth-cold produced calmer pleasant states. These findings suggest that pseudo-haptics in XR may be better understood as an affective feedback channel rather than a direct replacement for physical touch in controller-free systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_23747 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Feelings, Not Feel: Affective Audio-Visual Pseudo-Haptics in Hand-Tracked XR David, Kristian Paolo Maria, Tyrone Justin Sta Gamboa, Mikkel Dominic Deja, Jordan Aiko Human-Computer Interaction Hand-tracking enables controller-free XR interaction but does not have the tactile feedback controllers provide. Rather than treating this solely as a missing-sensation problem, we explore whether pseudo-haptic cues on an embodied virtual hand act as tactile or as affect substitutes that shape how interactions feel. We used a mixed reality prototype that keeps the contacted surface visually neutral, rendering cues on the hand with motion modulation for texture, color glow, and movement-coupled sound. In a within-subjects study (n=12), participants experienced 12 conditions (4 effects x 3 modalities: audio, visual, both) and reported subjective affect and cognitive demand. Participants rarely reported sustained tactile, thermal sensations, yet affect shifted systematically: rough-hot lowered valence increasing arousal, while smooth-cold produced calmer pleasant states. These findings suggest that pseudo-haptics in XR may be better understood as an affective feedback channel rather than a direct replacement for physical touch in controller-free systems. |
| title | Feelings, Not Feel: Affective Audio-Visual Pseudo-Haptics in Hand-Tracked XR |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2602.23747 |