Simultaneous Control of Human Hand Joint Positions and Grip Force via HD-EMG and Deep Learning
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866913569027653632 |
|---|---|
| author | Rahimi, Farnaz Badamchizadeh, Mohammad Ali Sîmpetru, Raul C. Ghaemi, Sehraneh Eskofier, Bjoern M. Del Vecchio, Alessandro |
| author_facet | Rahimi, Farnaz Badamchizadeh, Mohammad Ali Sîmpetru, Raul C. Ghaemi, Sehraneh Eskofier, Bjoern M. Del Vecchio, Alessandro |
| contents | In myoelectric control, simultaneous control of multiple degrees of freedom can be challenging due to the dexterity of the human hand. Numerous studies have focused on hand functionality, however, they only focused on a few degrees of freedom. In this paper, a 3DCNN-MLP model is proposed that uses high-density sEMG signals to estimate 20 hand joint positions and grip force simultaneously. The deep learning model maps the muscle activity to the hand kinematics and kinetics. The proposed models' performance is also evaluated in estimating grip forces with real-time resolution. This paper investigated three individual dynamic hand movements (2pinch, 3pinch, and fist closing and opening) while applying forces in 10% and 30% of the maximum voluntary contraction (MVC). The results demonstrated significant accuracy in estimating kinetics and kinematics. The average Euclidean distance across all joints and subjects was 11.01 $\pm$ 2.22 mm and the mean absolute error for offline and real-time force estimation were found to be 0.8 $\pm$ 0.33 N and 2.09 $\pm$ 0.9 N respectively. The results demonstrate that by leveraging high-density sEMG and deep learning, it is possible to estimate human hand dynamics (kinematics and kinetics), which is a step forward to practical prosthetic hands. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_23986 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Simultaneous Control of Human Hand Joint Positions and Grip Force via HD-EMG and Deep Learning Rahimi, Farnaz Badamchizadeh, Mohammad Ali Sîmpetru, Raul C. Ghaemi, Sehraneh Eskofier, Bjoern M. Del Vecchio, Alessandro Human-Computer Interaction In myoelectric control, simultaneous control of multiple degrees of freedom can be challenging due to the dexterity of the human hand. Numerous studies have focused on hand functionality, however, they only focused on a few degrees of freedom. In this paper, a 3DCNN-MLP model is proposed that uses high-density sEMG signals to estimate 20 hand joint positions and grip force simultaneously. The deep learning model maps the muscle activity to the hand kinematics and kinetics. The proposed models' performance is also evaluated in estimating grip forces with real-time resolution. This paper investigated three individual dynamic hand movements (2pinch, 3pinch, and fist closing and opening) while applying forces in 10% and 30% of the maximum voluntary contraction (MVC). The results demonstrated significant accuracy in estimating kinetics and kinematics. The average Euclidean distance across all joints and subjects was 11.01 $\pm$ 2.22 mm and the mean absolute error for offline and real-time force estimation were found to be 0.8 $\pm$ 0.33 N and 2.09 $\pm$ 0.9 N respectively. The results demonstrate that by leveraging high-density sEMG and deep learning, it is possible to estimate human hand dynamics (kinematics and kinetics), which is a step forward to practical prosthetic hands. |
| title | Simultaneous Control of Human Hand Joint Positions and Grip Force via HD-EMG and Deep Learning |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2410.23986 |