WLASL-LEX: a Dataset for Recognising Phonological Properties in American Sign Language
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913442945826816 |
|---|---|
| author | Tavella, Federico Schlegel, Viktor Romeo, Marta Galata, Aphrodite Cangelosi, Angelo |
| author_facet | Tavella, Federico Schlegel, Viktor Romeo, Marta Galata, Aphrodite Cangelosi, Angelo |
| contents | Signed Language Processing (SLP) concerns the automated processing of signed languages, the main means of communication of Deaf and hearing impaired individuals. SLP features many different tasks, ranging from sign recognition to translation and production of signed speech, but has been overlooked by the NLP community thus far. In this paper, we bring to attention the task of modelling the phonology of sign languages. We leverage existing resources to construct a large-scale dataset of American Sign Language signs annotated with six different phonological properties. We then conduct an extensive empirical study to investigate whether data-driven end-to-end and feature-based approaches can be optimised to automatically recognise these properties. We find that, despite the inherent challenges of the task, graph-based neural networks that operate over skeleton features extracted from raw videos are able to succeed at the task to a varying degree. Most importantly, we show that this performance pertains even on signs unobserved during training. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2203_06096 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | WLASL-LEX: a Dataset for Recognising Phonological Properties in American Sign Language Tavella, Federico Schlegel, Viktor Romeo, Marta Galata, Aphrodite Cangelosi, Angelo Computation and Language Computer Vision and Pattern Recognition Machine Learning Signed Language Processing (SLP) concerns the automated processing of signed languages, the main means of communication of Deaf and hearing impaired individuals. SLP features many different tasks, ranging from sign recognition to translation and production of signed speech, but has been overlooked by the NLP community thus far. In this paper, we bring to attention the task of modelling the phonology of sign languages. We leverage existing resources to construct a large-scale dataset of American Sign Language signs annotated with six different phonological properties. We then conduct an extensive empirical study to investigate whether data-driven end-to-end and feature-based approaches can be optimised to automatically recognise these properties. We find that, despite the inherent challenges of the task, graph-based neural networks that operate over skeleton features extracted from raw videos are able to succeed at the task to a varying degree. Most importantly, we show that this performance pertains even on signs unobserved during training. |
| title | WLASL-LEX: a Dataset for Recognising Phonological Properties in American Sign Language |
| topic | Computation and Language Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2203.06096 |