Musinger: Communication of Music over a Distance with Wearable Haptic Display and Touch Sensitive Surface

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cabrera, Miguel Altamirano, Khan, Muhammad Haris, Alabbas, Ali, Moreno, Luis, Tokmurziyev, Issatay, Tsetserukou, Dzmitry
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913557956788224
author Cabrera, Miguel Altamirano
Khan, Muhammad Haris
Alabbas, Ali
Moreno, Luis
Tokmurziyev, Issatay
Tsetserukou, Dzmitry
author_facet Cabrera, Miguel Altamirano
Khan, Muhammad Haris
Alabbas, Ali
Moreno, Luis
Tokmurziyev, Issatay
Tsetserukou, Dzmitry
contents This study explores the integration of auditory and tactile experiences in musical haptics, focusing on enhancing sensory dimensions of music through touch. Addressing the gap in translating auditory signals to meaningful tactile feedback, our research introduces a novel method involving a touch-sensitive recorder and a wearable haptic display that captures musical interactions via force sensors and converts these into tactile sensations. Previous studies have shown the potential of haptic feedback to enhance musical expressivity, yet challenges remain in conveying complex musical nuances. Our method aims to expand music accessibility for individuals with hearing impairments and deepen digital musical interactions. Experimental results reveal high accuracy ($98\%$ without noise, 93% with white noise) in melody recognition through tactile feedback, demonstrating effective transmission and perception of musical information. The findings highlight the potential of haptic technology to bridge sensory gaps, offering significant implications for music therapy, education, and remote musical collaboration, advancing the field of musical haptics and multi-sensory technology applications.
format Preprint
id arxiv_https___arxiv_org_abs_2410_16202
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Musinger: Communication of Music over a Distance with Wearable Haptic Display and Touch Sensitive Surface
Cabrera, Miguel Altamirano
Khan, Muhammad Haris
Alabbas, Ali
Moreno, Luis
Tokmurziyev, Issatay
Tsetserukou, Dzmitry
Human-Computer Interaction
This study explores the integration of auditory and tactile experiences in musical haptics, focusing on enhancing sensory dimensions of music through touch. Addressing the gap in translating auditory signals to meaningful tactile feedback, our research introduces a novel method involving a touch-sensitive recorder and a wearable haptic display that captures musical interactions via force sensors and converts these into tactile sensations. Previous studies have shown the potential of haptic feedback to enhance musical expressivity, yet challenges remain in conveying complex musical nuances. Our method aims to expand music accessibility for individuals with hearing impairments and deepen digital musical interactions. Experimental results reveal high accuracy ($98\%$ without noise, 93% with white noise) in melody recognition through tactile feedback, demonstrating effective transmission and perception of musical information. The findings highlight the potential of haptic technology to bridge sensory gaps, offering significant implications for music therapy, education, and remote musical collaboration, advancing the field of musical haptics and multi-sensory technology applications.
title Musinger: Communication of Music over a Distance with Wearable Haptic Display and Touch Sensitive Surface
topic Human-Computer Interaction
url https://arxiv.org/abs/2410.16202