Improving Handshape Representations for Sign Language Processing: A Graph Neural Network Approach
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916961813790720 |
|---|---|
| author | Carbo, Alessa Nalisnick, Eric |
| author_facet | Carbo, Alessa Nalisnick, Eric |
| contents | Handshapes serve a fundamental phonological role in signed languages, with American Sign Language employing approximately 50 distinct shapes. However,computational approaches rarely model handshapes explicitly, limiting both recognition accuracy and linguistic analysis.We introduce a novel graph neural network that separates temporal dynamics from static handshape configurations. Our approach combines anatomically-informed graph structures with contrastive learning to address key challenges in handshape recognition, including subtle interclass distinctions and temporal variations. We establish the first benchmark for structured handshape recognition in signing sequences, achieving 46% accuracy across 37 handshape classes (with baseline methods achieving 25%). |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_18309 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Improving Handshape Representations for Sign Language Processing: A Graph Neural Network Approach Carbo, Alessa Nalisnick, Eric Computer Vision and Pattern Recognition Machine Learning I.2.10 Handshapes serve a fundamental phonological role in signed languages, with American Sign Language employing approximately 50 distinct shapes. However,computational approaches rarely model handshapes explicitly, limiting both recognition accuracy and linguistic analysis.We introduce a novel graph neural network that separates temporal dynamics from static handshape configurations. Our approach combines anatomically-informed graph structures with contrastive learning to address key challenges in handshape recognition, including subtle interclass distinctions and temporal variations. We establish the first benchmark for structured handshape recognition in signing sequences, achieving 46% accuracy across 37 handshape classes (with baseline methods achieving 25%). |
| title | Improving Handshape Representations for Sign Language Processing: A Graph Neural Network Approach |
| topic | Computer Vision and Pattern Recognition Machine Learning I.2.10 |
| url | https://arxiv.org/abs/2509.18309 |