Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Yinghui, Qin, Shang, Huang, Haojing, Li, Yangning, Qin, Libo, Hu, Xuming, Jiang, Wenhao, Zheng, Hai-Tao, Yu, Philip S.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916400350625792
author Li, Yinghui
Qin, Shang
Huang, Haojing
Li, Yangning
Qin, Libo
Hu, Xuming
Jiang, Wenhao
Zheng, Hai-Tao
Yu, Philip S.
author_facet Li, Yinghui
Qin, Shang
Huang, Haojing
Li, Yangning
Qin, Libo
Hu, Xuming
Jiang, Wenhao
Zheng, Hai-Tao
Yu, Philip S.
contents Recently, Large Language Models (LLMs) have been widely studied by researchers for their roles in various downstream NLP tasks. As a fundamental task in the NLP field, Chinese Grammatical Error Correction (CGEC) aims to correct all potential grammatical errors in the input sentences. Previous studies have shown that LLMs' performance as correctors on CGEC remains unsatisfactory due to its challenging task focus. To promote the CGEC field to better adapt to the era of LLMs, we rethink the roles of LLMs in the CGEC task so that they can be better utilized and explored in CGEC. Considering the rich grammatical knowledge stored in LLMs and their powerful semantic understanding capabilities, we utilize LLMs as explainers to provide explanation information for the CGEC small models during error correction to enhance performance. We also use LLMs as evaluators to bring more reasonable CGEC evaluations, thus alleviating the troubles caused by the subjectivity of the CGEC task. In particular, our work is also an active exploration of how LLMs and small models better collaborate in downstream tasks. Extensive experiments and detailed analyses on widely used datasets verify the effectiveness of our thinking intuition and the proposed methods.
format Preprint
id arxiv_https___arxiv_org_abs_2402_11420
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction
Li, Yinghui
Qin, Shang
Huang, Haojing
Li, Yangning
Qin, Libo
Hu, Xuming
Jiang, Wenhao
Zheng, Hai-Tao
Yu, Philip S.
Computation and Language
Recently, Large Language Models (LLMs) have been widely studied by researchers for their roles in various downstream NLP tasks. As a fundamental task in the NLP field, Chinese Grammatical Error Correction (CGEC) aims to correct all potential grammatical errors in the input sentences. Previous studies have shown that LLMs' performance as correctors on CGEC remains unsatisfactory due to its challenging task focus. To promote the CGEC field to better adapt to the era of LLMs, we rethink the roles of LLMs in the CGEC task so that they can be better utilized and explored in CGEC. Considering the rich grammatical knowledge stored in LLMs and their powerful semantic understanding capabilities, we utilize LLMs as explainers to provide explanation information for the CGEC small models during error correction to enhance performance. We also use LLMs as evaluators to bring more reasonable CGEC evaluations, thus alleviating the troubles caused by the subjectivity of the CGEC task. In particular, our work is also an active exploration of how LLMs and small models better collaborate in downstream tasks. Extensive experiments and detailed analyses on widely used datasets verify the effectiveness of our thinking intuition and the proposed methods.
title Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction
topic Computation and Language
url https://arxiv.org/abs/2402.11420