Advancing Automated Speaking Assessment Leveraging Multifaceted Relevance and Grammar Information
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918065488265216 |
|---|---|
| author | Lu, Hao-Chien Lin, Jhen-Ke Lin, Hong-Yun Wang, Chung-Chun Chen, Berlin |
| author_facet | Lu, Hao-Chien Lin, Jhen-Ke Lin, Hong-Yun Wang, Chung-Chun Chen, Berlin |
| contents | Current automated speaking assessment (ASA) systems for use in multi-aspect evaluations often fail to make full use of content relevance, overlooking image or exemplar cues, and employ superficial grammar analysis that lacks detailed error types. This paper ameliorates these deficiencies by introducing two novel enhancements to construct a hybrid scoring model. First, a multifaceted relevance module integrates question and the associated image content, exemplar, and spoken response of an L2 speaker for a comprehensive assessment of content relevance. Second, fine-grained grammar error features are derived using advanced grammar error correction (GEC) and detailed annotation to identify specific error categories. Experiments and ablation studies demonstrate that these components significantly improve the evaluation of content relevance, language use, and overall ASA performance, highlighting the benefits of using richer, more nuanced feature sets for holistic speaking assessment. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_16285 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Advancing Automated Speaking Assessment Leveraging Multifaceted Relevance and Grammar Information Lu, Hao-Chien Lin, Jhen-Ke Lin, Hong-Yun Wang, Chung-Chun Chen, Berlin Computation and Language Sound Audio and Speech Processing Current automated speaking assessment (ASA) systems for use in multi-aspect evaluations often fail to make full use of content relevance, overlooking image or exemplar cues, and employ superficial grammar analysis that lacks detailed error types. This paper ameliorates these deficiencies by introducing two novel enhancements to construct a hybrid scoring model. First, a multifaceted relevance module integrates question and the associated image content, exemplar, and spoken response of an L2 speaker for a comprehensive assessment of content relevance. Second, fine-grained grammar error features are derived using advanced grammar error correction (GEC) and detailed annotation to identify specific error categories. Experiments and ablation studies demonstrate that these components significantly improve the evaluation of content relevance, language use, and overall ASA performance, highlighting the benefits of using richer, more nuanced feature sets for holistic speaking assessment. |
| title | Advancing Automated Speaking Assessment Leveraging Multifaceted Relevance and Grammar Information |
| topic | Computation and Language Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2506.16285 |