3D Modeling of the Mexican Sign Language for a Speech-to-Sign Language System
Fuente:
Redalyc
Enregistré dans:
| Auteur principal: | |
|---|---|
| Format: | Artículo científico |
| Langue: | en |
| Publié: |
Instituto Politécnico Nacional
2013
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1876489983132434432 |
|---|---|
| author | Santiago-Omar Caballero-Morales |
| author_facet | Santiago-Omar Caballero-Morales |
| contents | 3D Modeling of the Mexican Sign Language for a Speech-to-Sign Language System Santiago-Omar Caballero-Morales Felipe Trujillo-Romero Computación human computer interaction Mexican sign language automatic speech recognition There are many people with communication impairments, deafness being one of the most common of them. Deaf people use Sign Language (SL) to communicate, and translation systems (Speech/Text- to-SL) have been developed to assist such communication. However, since SLs are dependent of countries and cultures, there are differences between grammars, vocabularies, and signs, even if these come from places with similar spoken languages. In Mexico, work in this field is very limited, so any development must consider the characteristics of the Mexican-Sign- Language (MSL). In this paper, we present a new approach to creating a Mexican Speech-to-SL system, integrating 3D modeling of the MSL with a multi-user Automatic Speech Recognizer (ASR) with dynamic adaptation. The 3D models (avatar) were developed by means of motion capture of a MSL performer. Kinect was used as a 3D sensor for the motion capture process, and DAZ Studio 4 was used for its animation. The multi-user ASR was developed using the HTK and Matlab as the programming platform for a Graphical User Interface (GUI). Experiments with a vocabulary set of 199 words were performed to validate the system. An accuracy of 96.2% was achieved for the ASR and interpretation into MSL of 70 words and 20 spoken sentences. The 3D avatar presented clearer realizations than those of standard video recordings of a human MSL performer. 2013 artículo científico 1405-5546 https://www.redalyc.org/articulo.oa?id=61529295012 en http://www.redalyc.org/revista.oa?id=615 Computación y Sistemas application/pdf Instituto Politécnico Nacional Computación y Sistemas (México) Num.4 Vol.17 |
| format | Artículo científico |
| id | redalyc_61529295012 |
| institution | Redalyc |
| language | en |
| publishDate | 2013 |
| publisher | Instituto Politécnico Nacional |
| spellingShingle | 3D Modeling of the Mexican Sign Language for a Speech-to-Sign Language System Santiago-Omar Caballero-Morales Computación human computer interaction Mexican sign language automatic speech recognition 3D Modeling of the Mexican Sign Language for a Speech-to-Sign Language System Santiago-Omar Caballero-Morales Felipe Trujillo-Romero Computación human computer interaction Mexican sign language automatic speech recognition There are many people with communication impairments, deafness being one of the most common of them. Deaf people use Sign Language (SL) to communicate, and translation systems (Speech/Text- to-SL) have been developed to assist such communication. However, since SLs are dependent of countries and cultures, there are differences between grammars, vocabularies, and signs, even if these come from places with similar spoken languages. In Mexico, work in this field is very limited, so any development must consider the characteristics of the Mexican-Sign- Language (MSL). In this paper, we present a new approach to creating a Mexican Speech-to-SL system, integrating 3D modeling of the MSL with a multi-user Automatic Speech Recognizer (ASR) with dynamic adaptation. The 3D models (avatar) were developed by means of motion capture of a MSL performer. Kinect was used as a 3D sensor for the motion capture process, and DAZ Studio 4 was used for its animation. The multi-user ASR was developed using the HTK and Matlab as the programming platform for a Graphical User Interface (GUI). Experiments with a vocabulary set of 199 words were performed to validate the system. An accuracy of 96.2% was achieved for the ASR and interpretation into MSL of 70 words and 20 spoken sentences. The 3D avatar presented clearer realizations than those of standard video recordings of a human MSL performer. 2013 artículo científico 1405-5546 https://www.redalyc.org/articulo.oa?id=61529295012 en http://www.redalyc.org/revista.oa?id=615 Computación y Sistemas application/pdf Instituto Politécnico Nacional Computación y Sistemas (México) Num.4 Vol.17 |
| title | 3D Modeling of the Mexican Sign Language for a Speech-to-Sign Language System |
| topic | Computación human computer interaction Mexican sign language automatic speech recognition |
| url | https://www.redalyc.org/articulo.oa?id=61529295012 |