Generation of Bilingual Dictionaries using Structural Properties

Fuente: Redalyc
Salvato in:
Dettagli Bibliografici
Autore principale: Ajay Dubey
Natura: Artículo científico
Lingua:en
Pubblicazione: Instituto Politécnico Nacional 2013
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1876472351691898880
author Ajay Dubey
author_facet Ajay Dubey
contents Generation of Bilingual Dictionaries using Structural Properties Ajay Dubey Vasudeva Varma Computación comparable corpora structural elements Bilingual dictionary Building bilingual dictionaries from Wikipedia has been extensively studied in the area of computation linguistics. These dictionaries play a crucial role in Natural Language Processing(NLP) applications like Cross-Lingual Information Retrieval, Machine Translation and Named Entity Recognition. To build these dictionaries, most of the existing approaches use information present in Wikipedia titles, info-boxes and categories. Interestingly, not many use the structural properties of a document like sections, subsections, etc. In this work we exploit the structural properties of documents to build a bilingual English-Hindi dictionary. The main intuition behind this approach is that documents in different languages discussing the same topic are likely to have similar structural elements. Though we present our experiments only for Hindi, our approach is language independent and can be easily extended to other languages. The major contribution of our work is that the dictionary contains translation and transliteration of words which include Named Entities to a large extent. We evaluate our dictionary using manually computed precision. We generated a massive list of 72k tokens using our approach with 0.75 precision. 2013 artículo científico 1405-5546 https://www.redalyc.org/articulo.oa?id=61527437006 en http://www.redalyc.org/revista.oa?id=615 Computación y Sistemas application/pdf Instituto Politécnico Nacional Computación y Sistemas (México) Num.2 Vol.17
format Artículo científico
id redalyc_61527437006
institution Redalyc
language en
publishDate 2013
publisher Instituto Politécnico Nacional
spellingShingle Generation of Bilingual Dictionaries using Structural Properties
Ajay Dubey
Computación
comparable corpora
structural elements
Bilingual dictionary
Generation of Bilingual Dictionaries using Structural Properties Ajay Dubey Vasudeva Varma Computación comparable corpora structural elements Bilingual dictionary Building bilingual dictionaries from Wikipedia has been extensively studied in the area of computation linguistics. These dictionaries play a crucial role in Natural Language Processing(NLP) applications like Cross-Lingual Information Retrieval, Machine Translation and Named Entity Recognition. To build these dictionaries, most of the existing approaches use information present in Wikipedia titles, info-boxes and categories. Interestingly, not many use the structural properties of a document like sections, subsections, etc. In this work we exploit the structural properties of documents to build a bilingual English-Hindi dictionary. The main intuition behind this approach is that documents in different languages discussing the same topic are likely to have similar structural elements. Though we present our experiments only for Hindi, our approach is language independent and can be easily extended to other languages. The major contribution of our work is that the dictionary contains translation and transliteration of words which include Named Entities to a large extent. We evaluate our dictionary using manually computed precision. We generated a massive list of 72k tokens using our approach with 0.75 precision. 2013 artículo científico 1405-5546 https://www.redalyc.org/articulo.oa?id=61527437006 en http://www.redalyc.org/revista.oa?id=615 Computación y Sistemas application/pdf Instituto Politécnico Nacional Computación y Sistemas (México) Num.2 Vol.17
title Generation of Bilingual Dictionaries using Structural Properties
topic Computación
comparable corpora
structural elements
Bilingual dictionary
url https://www.redalyc.org/articulo.oa?id=61527437006