Non-invasive electromyographic speech neuroprosthesis: a geometric perspective

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gowda, Harshavardhana T., Miller, Lee M.
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913043311493120
author Gowda, Harshavardhana T.
Miller, Lee M.
author_facet Gowda, Harshavardhana T.
Miller, Lee M.
contents We present a neuromuscular speech interface that translates silently voiced articulations directly into text. We record surface electromyographic (EMG) signals from multiple articulatory sites on the face and neck as participants silently articulate speech, enabling direct EMG-to-text translation. Such an interface has the potential to restore communication for individuals who have lost the ability to produce intelligible speech due to laryngectomy, neuromuscular disease, stroke, or trauma-induced damage (e.g., radiotherapy toxicity) to the speech articulators. Prior work has largely focused on mapping EMG collected during audible articulation to time-aligned audio targets or transferring these targets to silent EMG recordings, which inherently requires audio and limits applicability to patients who can no longer speak. In contrast, we propose an efficient representation of high-dimensional EMG signals and demonstrate direct sequence-to-sequence EMG-to-text conversion at the phonemic level without relying on time-aligned audio.
format Preprint
id arxiv_https___arxiv_org_abs_2502_05762
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Non-invasive electromyographic speech neuroprosthesis: a geometric perspective
Gowda, Harshavardhana T.
Miller, Lee M.
Audio and Speech Processing
We present a neuromuscular speech interface that translates silently voiced articulations directly into text. We record surface electromyographic (EMG) signals from multiple articulatory sites on the face and neck as participants silently articulate speech, enabling direct EMG-to-text translation. Such an interface has the potential to restore communication for individuals who have lost the ability to produce intelligible speech due to laryngectomy, neuromuscular disease, stroke, or trauma-induced damage (e.g., radiotherapy toxicity) to the speech articulators. Prior work has largely focused on mapping EMG collected during audible articulation to time-aligned audio targets or transferring these targets to silent EMG recordings, which inherently requires audio and limits applicability to patients who can no longer speak. In contrast, we propose an efficient representation of high-dimensional EMG signals and demonstrate direct sequence-to-sequence EMG-to-text conversion at the phonemic level without relying on time-aligned audio.
title Non-invasive electromyographic speech neuroprosthesis: a geometric perspective
topic Audio and Speech Processing
url https://arxiv.org/abs/2502.05762