Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Mallart, Cyriel, Simpkin, Andrew, Ballier, Nicolas, Lissón, Paula, Venant, Rémi, Li, Jen-Yu, Stearns, Bernardo, Gaillat, Thomas
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:https://arxiv.org/abs/2503.10220
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866910874934968320
author Mallart, Cyriel
Simpkin, Andrew
Ballier, Nicolas
Lissón, Paula
Venant, Rémi
Li, Jen-Yu
Stearns, Bernardo
Gaillat, Thomas
author_facet Mallart, Cyriel
Simpkin, Andrew
Ballier, Nicolas
Lissón, Paula
Venant, Rémi
Li, Jen-Yu
Stearns, Bernardo
Gaillat, Thomas
contents This article addresses Second Language (L2) writing development through an investigation of new grammatical and structural complexity metrics. We explore the paradigmatic production in learner English by linking language functions to specific grammatical paradigms. Using the EFCAMDAT as a gold standard and a corpus of French learners as an external test set, we employ a supervised learning framework to operationalise and evaluate seven microsystems. We show that learner levels are associated with the seven microsystems (MS). Using ordinal regression modelling for evaluation, the results show that all MS are significant but yield a low impact if taken individually. However, their influence is shown to be impactful if taken as a group. These microsystems and their measurement method suggest that it is possible to use them as part of broader-purpose CALL systems focused on proficiency assessment.
format Preprint
id arxiv_https___arxiv_org_abs_2503_10220
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Assessing the validity of new paradigmatic complexity measures as criterial features for proficiency in L2 writings in English
Mallart, Cyriel
Simpkin, Andrew
Ballier, Nicolas
Lissón, Paula
Venant, Rémi
Li, Jen-Yu
Stearns, Bernardo
Gaillat, Thomas
Computation and Language
Machine Learning
This article addresses Second Language (L2) writing development through an investigation of new grammatical and structural complexity metrics. We explore the paradigmatic production in learner English by linking language functions to specific grammatical paradigms. Using the EFCAMDAT as a gold standard and a corpus of French learners as an external test set, we employ a supervised learning framework to operationalise and evaluate seven microsystems. We show that learner levels are associated with the seven microsystems (MS). Using ordinal regression modelling for evaluation, the results show that all MS are significant but yield a low impact if taken individually. However, their influence is shown to be impactful if taken as a group. These microsystems and their measurement method suggest that it is possible to use them as part of broader-purpose CALL systems focused on proficiency assessment.
title Assessing the validity of new paradigmatic complexity measures as criterial features for proficiency in L2 writings in English
topic Computation and Language
Machine Learning
url https://arxiv.org/abs/2503.10220