Classification in Japanese Sign Language Based on Dynamic Facial Expressions
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908417682046976 |
|---|---|
| author | Tatsumi, Yui Tanaka, Shoko Akamatsu, Shunsuke Shindo, Takahiro Watanabe, Hiroshi |
| author_facet | Tatsumi, Yui Tanaka, Shoko Akamatsu, Shunsuke Shindo, Takahiro Watanabe, Hiroshi |
| contents | Sign language is a visual language expressed through hand movements and non-manual markers. Non-manual markers include facial expressions and head movements. These expressions vary across different nations. Therefore, specialized analysis methods for each sign language are necessary. However, research on Japanese Sign Language (JSL) recognition is limited due to a lack of datasets. The development of recognition models that consider both manual and non-manual features of JSL is crucial for precise and smooth communication with deaf individuals. In JSL, sentence types such as affirmative statements and questions are distinguished by facial expressions. In this paper, we propose a JSL recognition method that focuses on facial expressions. Our proposed method utilizes a neural network to analyze facial features and classify sentence types. Through the experiments, we confirm our method's effectiveness by achieving a classification accuracy of 96.05%. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_06347 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Classification in Japanese Sign Language Based on Dynamic Facial Expressions Tatsumi, Yui Tanaka, Shoko Akamatsu, Shunsuke Shindo, Takahiro Watanabe, Hiroshi Computer Vision and Pattern Recognition Sign language is a visual language expressed through hand movements and non-manual markers. Non-manual markers include facial expressions and head movements. These expressions vary across different nations. Therefore, specialized analysis methods for each sign language are necessary. However, research on Japanese Sign Language (JSL) recognition is limited due to a lack of datasets. The development of recognition models that consider both manual and non-manual features of JSL is crucial for precise and smooth communication with deaf individuals. In JSL, sentence types such as affirmative statements and questions are distinguished by facial expressions. In this paper, we propose a JSL recognition method that focuses on facial expressions. Our proposed method utilizes a neural network to analyze facial features and classify sentence types. Through the experiments, we confirm our method's effectiveness by achieving a classification accuracy of 96.05%. |
| title | Classification in Japanese Sign Language Based on Dynamic Facial Expressions |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2411.06347 |