Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.02573 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914783893127168 |
|---|---|
| author | Trung, Hieu Ngo Ham, Duong Tran Huynh, Tin Hoang, Kiem |
| author_facet | Trung, Hieu Ngo Ham, Duong Tran Huynh, Tin Hoang, Kiem |
| contents | Recently, many studies have shown the efficiency of using Bidirectional Encoder Representations from Transformers (BERT) in various Natural Language Processing (NLP) tasks. Specifically, English spelling correction task that uses Encoder-Decoder architecture and takes advantage of BERT has achieved state-of-the-art result. However, to our knowledge, there is no implementation in Vietnamese yet. Therefore, in this study, a combination of Transformer architecture (state-of-the-art for Encoder-Decoder model) and BERT was proposed to deal with Vietnamese spelling correction. The experiment results have shown that our model outperforms other approaches as well as the Google Docs Spell Checking tool, achieves an 86.24 BLEU score on this task. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_02573 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A Combination of BERT and Transformer for Vietnamese Spelling Correction Trung, Hieu Ngo Ham, Duong Tran Huynh, Tin Hoang, Kiem Computation and Language Recently, many studies have shown the efficiency of using Bidirectional Encoder Representations from Transformers (BERT) in various Natural Language Processing (NLP) tasks. Specifically, English spelling correction task that uses Encoder-Decoder architecture and takes advantage of BERT has achieved state-of-the-art result. However, to our knowledge, there is no implementation in Vietnamese yet. Therefore, in this study, a combination of Transformer architecture (state-of-the-art for Encoder-Decoder model) and BERT was proposed to deal with Vietnamese spelling correction. The experiment results have shown that our model outperforms other approaches as well as the Google Docs Spell Checking tool, achieves an 86.24 BLEU score on this task. |
| title | A Combination of BERT and Transformer for Vietnamese Spelling Correction |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2405.02573 |