EASSE-DE: Easier Automatic Sentence Simplification Evaluation for German

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteur principal: Stodden, Regina
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910399184502784
author Stodden, Regina
author_facet Stodden, Regina
contents In this work, we propose EASSE-multi, a framework for easier automatic sentence evaluation for languages other than English. Compared to the original EASSE framework, EASSE-multi does not focus only on English. It contains tokenizers and versions of text simplification evaluation metrics which are suitable for multiple languages. In this paper, we exemplify the usage of EASSE-multi for German TS, resulting in EASSE-DE. Further, we compare text simplification results when evaluating with different language or tokenization settings of the metrics. Based on this, we formulate recommendations on how to make the evaluation of (German) TS models more transparent and better comparable. The code of EASSE-multi and its German specialisation (EASSE-DE) can be found at https://github.com/rstodden/easse-de.
format Preprint
id arxiv_https___arxiv_org_abs_2404_03563
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle EASSE-DE: Easier Automatic Sentence Simplification Evaluation for German
Stodden, Regina
Computation and Language
In this work, we propose EASSE-multi, a framework for easier automatic sentence evaluation for languages other than English. Compared to the original EASSE framework, EASSE-multi does not focus only on English. It contains tokenizers and versions of text simplification evaluation metrics which are suitable for multiple languages. In this paper, we exemplify the usage of EASSE-multi for German TS, resulting in EASSE-DE. Further, we compare text simplification results when evaluating with different language or tokenization settings of the metrics. Based on this, we formulate recommendations on how to make the evaluation of (German) TS models more transparent and better comparable. The code of EASSE-multi and its German specialisation (EASSE-DE) can be found at https://github.com/rstodden/easse-de.
title EASSE-DE: Easier Automatic Sentence Simplification Evaluation for German
topic Computation and Language
url https://arxiv.org/abs/2404.03563