Training program on sign language: social inclusion through Virtual Reality in ISENSE project

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Bisio, Alessia, Yeguas-Bolívar, Enrique, Aparicio-Martínez, Pilar, Redel-Macías, María Dolores, Pinzi, Sara, Rossi, Stefano, Taborri, Juri
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909156547493888
author Bisio, Alessia
Yeguas-Bolívar, Enrique
Aparicio-Martínez, Pilar
Redel-Macías, María Dolores
Pinzi, Sara
Rossi, Stefano
Taborri, Juri
author_facet Bisio, Alessia
Yeguas-Bolívar, Enrique
Aparicio-Martínez, Pilar
Redel-Macías, María Dolores
Pinzi, Sara
Rossi, Stefano
Taborri, Juri
contents Structured hand gestures that incorporate visual motions and signs are used in sign language. Sign language is a valuable means of daily communication for individuals who are deaf or have speech impairments, but it is still rare among hearing people, and fewer are capable of understand it. Within the academic context, parents and teachers play a crucial role in supporting deaf students from childhood by facilitating their learning of sign language. In the last years, among all the teaching tools useful for learning sign language, the use of Virtual Reality (VR) has increased, as it has been demonstrated to improve retention, memory and attention during the learning process. The ISENSE project has been created to assist students with deafness during their academic life by proposing different technological tools for teaching sign language to the hearing community in the academic context. As part of the ISENSE project, this work aims to develop an application for Spanish and Italian sign language recognition that exploits the VR environment to quickly and easily create a comprehensive database of signs and an Artificial Intelligence (AI)-based software to accurately classify and recognize static and dynamic signs: from letters to sentences.
format Preprint
id arxiv_https___arxiv_org_abs_2401_08714
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Training program on sign language: social inclusion through Virtual Reality in ISENSE project
Bisio, Alessia
Yeguas-Bolívar, Enrique
Aparicio-Martínez, Pilar
Redel-Macías, María Dolores
Pinzi, Sara
Rossi, Stefano
Taborri, Juri
Human-Computer Interaction
Artificial Intelligence
Computer Vision and Pattern Recognition
Graphics
Structured hand gestures that incorporate visual motions and signs are used in sign language. Sign language is a valuable means of daily communication for individuals who are deaf or have speech impairments, but it is still rare among hearing people, and fewer are capable of understand it. Within the academic context, parents and teachers play a crucial role in supporting deaf students from childhood by facilitating their learning of sign language. In the last years, among all the teaching tools useful for learning sign language, the use of Virtual Reality (VR) has increased, as it has been demonstrated to improve retention, memory and attention during the learning process. The ISENSE project has been created to assist students with deafness during their academic life by proposing different technological tools for teaching sign language to the hearing community in the academic context. As part of the ISENSE project, this work aims to develop an application for Spanish and Italian sign language recognition that exploits the VR environment to quickly and easily create a comprehensive database of signs and an Artificial Intelligence (AI)-based software to accurately classify and recognize static and dynamic signs: from letters to sentences.
title Training program on sign language: social inclusion through Virtual Reality in ISENSE project
topic Human-Computer Interaction
Artificial Intelligence
Computer Vision and Pattern Recognition
Graphics
url https://arxiv.org/abs/2401.08714