DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866908398271856640 |
|---|---|
| author | Qiao, Ziheng Zhou, Houquan Liu, Yumeng Li, Zhenghua Zhang, Min Zhang, Bo Li, Chen Zhang, Ji Huang, Fei |
| author_facet | Qiao, Ziheng Zhou, Houquan Liu, Yumeng Li, Zhenghua Zhang, Min Zhang, Bo Li, Chen Zhang, Ji Huang, Fei |
| contents | One key characteristic of the Chinese spelling check (CSC) task is that incorrect characters are usually similar to the correct ones in either phonetics or glyph. To accommodate this, previous works usually leverage confusion sets, which suffer from two problems, i.e., difficulty in determining which character pairs to include and lack of probabilities to distinguish items in the set. In this paper, we propose a light-weight plug-and-play DISC (i.e., decoding intervention with similarity of characters) module for CSC models.DISC measures phonetic and glyph similarities between characters and incorporates this similarity information only during the inference phase. This method can be easily integrated into various existing CSC models, such as ReaLiSe, SCOPE, and ReLM, without additional training costs. Experiments on three CSC benchmarks demonstrate that our proposed method significantly improves model performance, approaching and even surpassing the current state-of-the-art models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_12863 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check Qiao, Ziheng Zhou, Houquan Liu, Yumeng Li, Zhenghua Zhang, Min Zhang, Bo Li, Chen Zhang, Ji Huang, Fei Computation and Language Artificial Intelligence One key characteristic of the Chinese spelling check (CSC) task is that incorrect characters are usually similar to the correct ones in either phonetics or glyph. To accommodate this, previous works usually leverage confusion sets, which suffer from two problems, i.e., difficulty in determining which character pairs to include and lack of probabilities to distinguish items in the set. In this paper, we propose a light-weight plug-and-play DISC (i.e., decoding intervention with similarity of characters) module for CSC models.DISC measures phonetic and glyph similarities between characters and incorporates this similarity information only during the inference phase. This method can be easily integrated into various existing CSC models, such as ReaLiSe, SCOPE, and ReLM, without additional training costs. Experiments on three CSC benchmarks demonstrate that our proposed method significantly improves model performance, approaching and even surpassing the current state-of-the-art models. |
| title | DISC: Plug-and-Play Decoding Intervention with Similarity of Characters for Chinese Spelling Check |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2412.12863 |