Sensing Your Vocals: Exploring the Activity of Vocal Cord Muscles for Pitch Assessment Using Electromyography and Ultrasonography

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Chen, Kanyu, Panskus, Rebecca, Wu, Erwin, Peng, Yichen, Saito, Daichi, Kamiyama, Emiko, Li, Ruiteng, Liao, Chen-Chieh, Marky, Karola, Akira, Kato, Koike, Hideki, Kunze, Kai
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912975516860416
author Chen, Kanyu
Panskus, Rebecca
Wu, Erwin
Peng, Yichen
Saito, Daichi
Kamiyama, Emiko
Li, Ruiteng
Liao, Chen-Chieh
Marky, Karola
Akira, Kato
Koike, Hideki
Kunze, Kai
author_facet Chen, Kanyu
Panskus, Rebecca
Wu, Erwin
Peng, Yichen
Saito, Daichi
Kamiyama, Emiko
Li, Ruiteng
Liao, Chen-Chieh
Marky, Karola
Akira, Kato
Koike, Hideki
Kunze, Kai
contents Vocal training is difficult because the muscles that control pitch, resonance, and phonation are internal and invisible to learners. This paper investigates how Electromyography (EMG) and ultrasonic imaging (UI) can make these muscles observable for training purposes. We report three studies. First, we analyze the EMG and UI data from 16 singers (beginners, experienced & professionals), revealing differences among three vocal groups of the muscle control proficiency. Second, we use the collected data to create a system that visualizes an expert's muscle activity as reference. This system is tested in a user study with 12 novices, showing that EMG highlighted muscle activation nuances, while UI provided insights into vocal cord length and dynamics. Third, to compare our approach to traditional methods (audio analysis and coach instructions), we conducted a focus group study with 15 experienced singers. Our results suggest that EMG is promising for improving vocal skill development and enhancing feedback systems. We conclude the paper with a detailed comparison of the analyzed modalities (EMG, UI and traditional methods), resulting in recommendations to improve vocal muscle training systems.
format Preprint
id arxiv_https___arxiv_org_abs_2603_19698
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Sensing Your Vocals: Exploring the Activity of Vocal Cord Muscles for Pitch Assessment Using Electromyography and Ultrasonography
Chen, Kanyu
Panskus, Rebecca
Wu, Erwin
Peng, Yichen
Saito, Daichi
Kamiyama, Emiko
Li, Ruiteng
Liao, Chen-Chieh
Marky, Karola
Akira, Kato
Koike, Hideki
Kunze, Kai
Human-Computer Interaction
H.5.2; H.5.5; J.4
Vocal training is difficult because the muscles that control pitch, resonance, and phonation are internal and invisible to learners. This paper investigates how Electromyography (EMG) and ultrasonic imaging (UI) can make these muscles observable for training purposes. We report three studies. First, we analyze the EMG and UI data from 16 singers (beginners, experienced & professionals), revealing differences among three vocal groups of the muscle control proficiency. Second, we use the collected data to create a system that visualizes an expert's muscle activity as reference. This system is tested in a user study with 12 novices, showing that EMG highlighted muscle activation nuances, while UI provided insights into vocal cord length and dynamics. Third, to compare our approach to traditional methods (audio analysis and coach instructions), we conducted a focus group study with 15 experienced singers. Our results suggest that EMG is promising for improving vocal skill development and enhancing feedback systems. We conclude the paper with a detailed comparison of the analyzed modalities (EMG, UI and traditional methods), resulting in recommendations to improve vocal muscle training systems.
title Sensing Your Vocals: Exploring the Activity of Vocal Cord Muscles for Pitch Assessment Using Electromyography and Ultrasonography
topic Human-Computer Interaction
H.5.2; H.5.5; J.4
url https://arxiv.org/abs/2603.19698