Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2022
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2208.09709 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909057416167424 |
|---|---|
| author | Rahman, Chowdhury Rafeed Rahman, MD. Hasibur Zakir, Samiha Rafsan, Mohammad Ali, Mohammed Eunus |
| author_facet | Rahman, Chowdhury Rafeed Rahman, MD. Hasibur Zakir, Samiha Rafsan, Mohammad Ali, Mohammed Eunus |
| contents | Bangla typing is mostly performed using English keyboard and can be highly erroneous due to the presence of compound and similarly pronounced letters. Spelling correction of a misspelled word requires understanding of word typing pattern as well as the context of the word usage. A specialized BERT model named BSpell has been proposed in this paper targeted towards word for word correction in sentence level. BSpell contains an end-to-end trainable CNN sub-model named SemanticNet along with specialized auxiliary loss. This allows BSpell to specialize in highly inflected Bangla vocabulary in the presence of spelling errors. Furthermore, a hybrid pretraining scheme has been proposed for BSpell that combines word level and character level masking. Comparison on two Bangla and one Hindi spelling correction dataset shows the superiority of our proposed approach. BSpell is available as a Bangla spell checking tool via GitHub: https://github.com/Hasiburshanto/Bangla-Spell-Checker |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2208_09709 |
| institution | arXiv |
| publishDate | 2022 |
| record_format | arxiv |
| spellingShingle | BSpell: A CNN-Blended BERT Based Bangla Spell Checker Rahman, Chowdhury Rafeed Rahman, MD. Hasibur Zakir, Samiha Rafsan, Mohammad Ali, Mohammed Eunus Computation and Language Bangla typing is mostly performed using English keyboard and can be highly erroneous due to the presence of compound and similarly pronounced letters. Spelling correction of a misspelled word requires understanding of word typing pattern as well as the context of the word usage. A specialized BERT model named BSpell has been proposed in this paper targeted towards word for word correction in sentence level. BSpell contains an end-to-end trainable CNN sub-model named SemanticNet along with specialized auxiliary loss. This allows BSpell to specialize in highly inflected Bangla vocabulary in the presence of spelling errors. Furthermore, a hybrid pretraining scheme has been proposed for BSpell that combines word level and character level masking. Comparison on two Bangla and one Hindi spelling correction dataset shows the superiority of our proposed approach. BSpell is available as a Bangla spell checking tool via GitHub: https://github.com/Hasiburshanto/Bangla-Spell-Checker |
| title | BSpell: A CNN-Blended BERT Based Bangla Spell Checker |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2208.09709 |