Optical Text Recognition in Nepali and Bengali: A Transformer-based Approach
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914739313967104 |
|---|---|
| author | Hasan, S M Rakib Dhakal, Aakar Mehedi, Md Humaion Kabir Rasel, Annajiat Alim |
| author_facet | Hasan, S M Rakib Dhakal, Aakar Mehedi, Md Humaion Kabir Rasel, Annajiat Alim |
| contents | Efforts on the research and development of OCR systems for Low-Resource Languages are relatively new. Low-resource languages have little training data available for training Machine Translation systems or other systems. Even though a vast amount of text has been digitized and made available on the internet the text is still in PDF and Image format, which are not instantly accessible. This paper discusses text recognition for two scripts: Bengali and Nepali; there are about 300 and 40 million Bengali and Nepali speakers respectively. In this study, using encoder-decoder transformers, a model was developed, and its efficacy was assessed using a collection of optical text images, both handwritten and printed. The results signify that the suggested technique corresponds with current approaches and achieves high precision in recognizing text in Bengali and Nepali. This study can pave the way for the advanced and accessible study of linguistics in South East Asia. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_02375 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Optical Text Recognition in Nepali and Bengali: A Transformer-based Approach Hasan, S M Rakib Dhakal, Aakar Mehedi, Md Humaion Kabir Rasel, Annajiat Alim Computation and Language Efforts on the research and development of OCR systems for Low-Resource Languages are relatively new. Low-resource languages have little training data available for training Machine Translation systems or other systems. Even though a vast amount of text has been digitized and made available on the internet the text is still in PDF and Image format, which are not instantly accessible. This paper discusses text recognition for two scripts: Bengali and Nepali; there are about 300 and 40 million Bengali and Nepali speakers respectively. In this study, using encoder-decoder transformers, a model was developed, and its efficacy was assessed using a collection of optical text images, both handwritten and printed. The results signify that the suggested technique corresponds with current approaches and achieves high precision in recognizing text in Bengali and Nepali. This study can pave the way for the advanced and accessible study of linguistics in South East Asia. |
| title | Optical Text Recognition in Nepali and Bengali: A Transformer-based Approach |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2404.02375 |