Tactile Melodies: A Desk-Mounted Haptics for Perceiving Musical Experiences

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Moora, Raj Varshith, Prabhakar, Gowdham
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913466710753280
author Moora, Raj Varshith
Prabhakar, Gowdham
author_facet Moora, Raj Varshith
Prabhakar, Gowdham
contents This paper introduces a novel interface for experiencing music through haptic impulses to the palm of the hand. It presents a practical implementation of the system exploring the realm of musical haptics through the translation of MIDI data from a Digital Audio Workstation (DAW) into haptic sensations, from a set of haptic actuators, in real-time. It also includes a suitable music-to-haptic mapping strategy to translate notes from musical instruments to haptic feedback. The haptic actuators, placed strategically on the palmar surface of the hand allowed users to perceive music and were able to identify melody and rhythm of different musical compositions. A pilot user study conducted intended to assess the accuracy of the interface by testing the participants to select the correct audio presentation from the haptic presentation of the same musical composition. It presents a comparative study, differentiating between those with prior musical background and those without, in identifying the correct audio counterpart solely through haptic inputs. This pilot study delves into how users perceive and interpret haptic feedback within the context of musical compositions. The study showed promising results in enriching our understanding of user responses to haptic feedback in musical scenarios and exploring the intricacies of user experience with the system and its impact on musical interpretation.
format Preprint
id arxiv_https___arxiv_org_abs_2408_06449
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Tactile Melodies: A Desk-Mounted Haptics for Perceiving Musical Experiences
Moora, Raj Varshith
Prabhakar, Gowdham
Human-Computer Interaction
H.5.2; H.5.5
This paper introduces a novel interface for experiencing music through haptic impulses to the palm of the hand. It presents a practical implementation of the system exploring the realm of musical haptics through the translation of MIDI data from a Digital Audio Workstation (DAW) into haptic sensations, from a set of haptic actuators, in real-time. It also includes a suitable music-to-haptic mapping strategy to translate notes from musical instruments to haptic feedback. The haptic actuators, placed strategically on the palmar surface of the hand allowed users to perceive music and were able to identify melody and rhythm of different musical compositions. A pilot user study conducted intended to assess the accuracy of the interface by testing the participants to select the correct audio presentation from the haptic presentation of the same musical composition. It presents a comparative study, differentiating between those with prior musical background and those without, in identifying the correct audio counterpart solely through haptic inputs. This pilot study delves into how users perceive and interpret haptic feedback within the context of musical compositions. The study showed promising results in enriching our understanding of user responses to haptic feedback in musical scenarios and exploring the intricacies of user experience with the system and its impact on musical interpretation.
title Tactile Melodies: A Desk-Mounted Haptics for Perceiving Musical Experiences
topic Human-Computer Interaction
H.5.2; H.5.5
url https://arxiv.org/abs/2408.06449