Advancing Automated Speaking Assessment Leveraging Multifaceted Relevance and Grammar Information

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lu, Hao-Chien, Lin, Jhen-Ke, Lin, Hong-Yun, Wang, Chung-Chun, Chen, Berlin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918065488265216
author Lu, Hao-Chien
Lin, Jhen-Ke
Lin, Hong-Yun
Wang, Chung-Chun
Chen, Berlin
author_facet Lu, Hao-Chien
Lin, Jhen-Ke
Lin, Hong-Yun
Wang, Chung-Chun
Chen, Berlin
contents Current automated speaking assessment (ASA) systems for use in multi-aspect evaluations often fail to make full use of content relevance, overlooking image or exemplar cues, and employ superficial grammar analysis that lacks detailed error types. This paper ameliorates these deficiencies by introducing two novel enhancements to construct a hybrid scoring model. First, a multifaceted relevance module integrates question and the associated image content, exemplar, and spoken response of an L2 speaker for a comprehensive assessment of content relevance. Second, fine-grained grammar error features are derived using advanced grammar error correction (GEC) and detailed annotation to identify specific error categories. Experiments and ablation studies demonstrate that these components significantly improve the evaluation of content relevance, language use, and overall ASA performance, highlighting the benefits of using richer, more nuanced feature sets for holistic speaking assessment.
format Preprint
id arxiv_https___arxiv_org_abs_2506_16285
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Advancing Automated Speaking Assessment Leveraging Multifaceted Relevance and Grammar Information
Lu, Hao-Chien
Lin, Jhen-Ke
Lin, Hong-Yun
Wang, Chung-Chun
Chen, Berlin
Computation and Language
Sound
Audio and Speech Processing
Current automated speaking assessment (ASA) systems for use in multi-aspect evaluations often fail to make full use of content relevance, overlooking image or exemplar cues, and employ superficial grammar analysis that lacks detailed error types. This paper ameliorates these deficiencies by introducing two novel enhancements to construct a hybrid scoring model. First, a multifaceted relevance module integrates question and the associated image content, exemplar, and spoken response of an L2 speaker for a comprehensive assessment of content relevance. Second, fine-grained grammar error features are derived using advanced grammar error correction (GEC) and detailed annotation to identify specific error categories. Experiments and ablation studies demonstrate that these components significantly improve the evaluation of content relevance, language use, and overall ASA performance, highlighting the benefits of using richer, more nuanced feature sets for holistic speaking assessment.
title Advancing Automated Speaking Assessment Leveraging Multifaceted Relevance and Grammar Information
topic Computation and Language
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2506.16285