Translating Signals to Languages for sEMG-Based Activity Recognition

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Ming, Qu, Haoxuan, Ke, Qiuhong, Zhou, Wei, Rahmani, Hossein, Liu, Jun
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914587862892544
author Wang, Ming
Qu, Haoxuan
Ke, Qiuhong
Zhou, Wei
Rahmani, Hossein
Liu, Jun
author_facet Wang, Ming
Qu, Haoxuan
Ke, Qiuhong
Zhou, Wei
Rahmani, Hossein
Liu, Jun
contents Surface electromyography (sEMG) signal-based activity recognition has attracted increasing research attention in recent years. To develop accurate sEMG signal-based activity recognizers, numerous approaches have been proposed. Some studies focus on designing larger and more expressive model architectures to enhance the representational capacity of sEMG signals, while others aim to enrich model priors through large-scale pretraining, thereby improving recognition performance. Recently, large language models (LLMs) have shown remarkable generalization and reasoning capabilities in natural language processing, whose implicit knowledge, learned from extensive linguistic descriptions of actions, opens new possibilities for interpreting sEMG signals and inferring activity intentions. Motivated by this, we propose LLM-sEMG, a novel framework that leverages LLMs as sEMG activity recognizers. Within this framework, we design a language-oriented mapping mechanism that converts continuous sEMG sequences into sEMG language, integrating several strategies to further facilitate the signal-to-language mapping process. Extensive experiments demonstrate that the proposed framework achieves highly accurate sEMG signal-based activity recognition using large language models.
format Preprint
id arxiv_https___arxiv_org_abs_2605_22403
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Translating Signals to Languages for sEMG-Based Activity Recognition
Wang, Ming
Qu, Haoxuan
Ke, Qiuhong
Zhou, Wei
Rahmani, Hossein
Liu, Jun
Computer Vision and Pattern Recognition
Surface electromyography (sEMG) signal-based activity recognition has attracted increasing research attention in recent years. To develop accurate sEMG signal-based activity recognizers, numerous approaches have been proposed. Some studies focus on designing larger and more expressive model architectures to enhance the representational capacity of sEMG signals, while others aim to enrich model priors through large-scale pretraining, thereby improving recognition performance. Recently, large language models (LLMs) have shown remarkable generalization and reasoning capabilities in natural language processing, whose implicit knowledge, learned from extensive linguistic descriptions of actions, opens new possibilities for interpreting sEMG signals and inferring activity intentions. Motivated by this, we propose LLM-sEMG, a novel framework that leverages LLMs as sEMG activity recognizers. Within this framework, we design a language-oriented mapping mechanism that converts continuous sEMG sequences into sEMG language, integrating several strategies to further facilitate the signal-to-language mapping process. Extensive experiments demonstrate that the proposed framework achieves highly accurate sEMG signal-based activity recognition using large language models.
title Translating Signals to Languages for sEMG-Based Activity Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2605.22403