Saudi Sign Language Translation Using T5
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917007719399424 |
|---|---|
| author | Alhejab, Ali Zelezny, Tomas Alkanhal, Lamya Gruber, Ivan Alharbi, Yazeed Straka, Jakub Javorek, Vaclav Hruz, Marek Alkalifah, Badriah Ali, Ahmed |
| author_facet | Alhejab, Ali Zelezny, Tomas Alkanhal, Lamya Gruber, Ivan Alharbi, Yazeed Straka, Jakub Javorek, Vaclav Hruz, Marek Alkalifah, Badriah Ali, Ahmed |
| contents | This paper explores the application of T5 models for Saudi Sign Language (SSL) translation using a novel dataset. The SSL dataset includes three challenging testing protocols, enabling comprehensive evaluation across different scenarios. Additionally, it captures unique SSL characteristics, such as face coverings, which pose challenges for sign recognition and translation. In our experiments, we investigate the impact of pre-training on American Sign Language (ASL) data by comparing T5 models pre-trained on the YouTubeASL dataset with models trained directly on the SSL dataset. Experimental results demonstrate that pre-training on YouTubeASL significantly improves models' performance (roughly $3\times$ in BLEU-4), indicating cross-linguistic transferability in sign language models. Our findings highlight the benefits of leveraging large-scale ASL data to improve SSL translation and provide insights into the development of more effective sign language translation systems. Our code is publicly available at our GitHub repository. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_11183 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Saudi Sign Language Translation Using T5 Alhejab, Ali Zelezny, Tomas Alkanhal, Lamya Gruber, Ivan Alharbi, Yazeed Straka, Jakub Javorek, Vaclav Hruz, Marek Alkalifah, Badriah Ali, Ahmed Computer Vision and Pattern Recognition This paper explores the application of T5 models for Saudi Sign Language (SSL) translation using a novel dataset. The SSL dataset includes three challenging testing protocols, enabling comprehensive evaluation across different scenarios. Additionally, it captures unique SSL characteristics, such as face coverings, which pose challenges for sign recognition and translation. In our experiments, we investigate the impact of pre-training on American Sign Language (ASL) data by comparing T5 models pre-trained on the YouTubeASL dataset with models trained directly on the SSL dataset. Experimental results demonstrate that pre-training on YouTubeASL significantly improves models' performance (roughly $3\times$ in BLEU-4), indicating cross-linguistic transferability in sign language models. Our findings highlight the benefits of leveraging large-scale ASL data to improve SSL translation and provide insights into the development of more effective sign language translation systems. Our code is publicly available at our GitHub repository. |
| title | Saudi Sign Language Translation Using T5 |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2510.11183 |