Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correction
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914721315160064 |
|---|---|
| author | Li, Yinghui Ma, Shirong Chen, Shaoshen Huang, Haojing Huang, Shulin Li, Yangning Zheng, Hai-Tao Shen, Ying |
| author_facet | Li, Yinghui Ma, Shirong Chen, Shaoshen Huang, Haojing Huang, Shulin Li, Yangning Zheng, Hai-Tao Shen, Ying |
| contents | Chinese Text Error Correction (CTEC) aims to detect and correct errors in the input text, which benefits human daily life and various downstream tasks. Recent approaches mainly employ Pre-trained Language Models (PLMs) to resolve CTEC. Although PLMs have achieved remarkable success in CTEC, we argue that previous studies still overlook the importance of human thinking patterns. To enhance the development of PLMs for CTEC, inspired by humans' daily error-correcting behavior, we propose a novel model-agnostic progressive learning framework, named ProTEC, which guides PLMs-based CTEC models to learn to correct like humans. During the training process, ProTEC guides the model to learn text error correction by incorporating these sub-tasks into a progressive paradigm. During the inference process, the model completes these sub-tasks in turn to generate the correction results. Extensive experiments and detailed analyses demonstrate the effectiveness and efficiency of our proposed model-agnostic ProTEC framework. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2306_17447 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correction Li, Yinghui Ma, Shirong Chen, Shaoshen Huang, Haojing Huang, Shulin Li, Yangning Zheng, Hai-Tao Shen, Ying Computation and Language Chinese Text Error Correction (CTEC) aims to detect and correct errors in the input text, which benefits human daily life and various downstream tasks. Recent approaches mainly employ Pre-trained Language Models (PLMs) to resolve CTEC. Although PLMs have achieved remarkable success in CTEC, we argue that previous studies still overlook the importance of human thinking patterns. To enhance the development of PLMs for CTEC, inspired by humans' daily error-correcting behavior, we propose a novel model-agnostic progressive learning framework, named ProTEC, which guides PLMs-based CTEC models to learn to correct like humans. During the training process, ProTEC guides the model to learn text error correction by incorporating these sub-tasks into a progressive paradigm. During the inference process, the model completes these sub-tasks in turn to generate the correction results. Extensive experiments and detailed analyses demonstrate the effectiveness and efficiency of our proposed model-agnostic ProTEC framework. |
| title | Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correction |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2306.17447 |