The Multi-Range Theory of Translation Quality Measurement: MQM scoring models and Statistical Quality Control
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916345673678848 |
|---|---|
| author | Lommel, Arle Gladkoff, Serge Melby, Alan Wright, Sue Ellen Strandvik, Ingemar Gasova, Katerina Vaasa, Angelika Benzo, Andy Sparano, Romina Marazzato Foresi, Monica Innis, Johani Han, Lifeng Nenadic, Goran |
| author_facet | Lommel, Arle Gladkoff, Serge Melby, Alan Wright, Sue Ellen Strandvik, Ingemar Gasova, Katerina Vaasa, Angelika Benzo, Andy Sparano, Romina Marazzato Foresi, Monica Innis, Johani Han, Lifeng Nenadic, Goran |
| contents | The year 2024 marks the 10th anniversary of the Multidimensional Quality Metrics (MQM) framework for analytic translation quality evaluation. The MQM error typology has been widely used by practitioners in the translation and localization industry and has served as the basis for many derivative projects. The annual Conference on Machine Translation (WMT) shared tasks on both human and automatic translation quality evaluations used the MQM error typology.
The metric stands on two pillars: error typology and the scoring model. The scoring model calculates the quality score from annotation data, detailing how to convert error type and severity counts into numeric scores to determine if the content meets specifications. Previously, only the raw scoring model had been published. This April, the MQM Council published the Linear Calibrated Scoring Model, officially presented herein, along with the Non-Linear Scoring Model, which had not been published before.
This paper details the latest MQM developments and presents a universal approach to translation quality measurement across three sample size ranges. It also explains why Statistical Quality Control should be used for very small sample sizes, starting from a single sentence. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_16969 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The Multi-Range Theory of Translation Quality Measurement: MQM scoring models and Statistical Quality Control Lommel, Arle Gladkoff, Serge Melby, Alan Wright, Sue Ellen Strandvik, Ingemar Gasova, Katerina Vaasa, Angelika Benzo, Andy Sparano, Romina Marazzato Foresi, Monica Innis, Johani Han, Lifeng Nenadic, Goran Computation and Language Applications The year 2024 marks the 10th anniversary of the Multidimensional Quality Metrics (MQM) framework for analytic translation quality evaluation. The MQM error typology has been widely used by practitioners in the translation and localization industry and has served as the basis for many derivative projects. The annual Conference on Machine Translation (WMT) shared tasks on both human and automatic translation quality evaluations used the MQM error typology. The metric stands on two pillars: error typology and the scoring model. The scoring model calculates the quality score from annotation data, detailing how to convert error type and severity counts into numeric scores to determine if the content meets specifications. Previously, only the raw scoring model had been published. This April, the MQM Council published the Linear Calibrated Scoring Model, officially presented herein, along with the Non-Linear Scoring Model, which had not been published before. This paper details the latest MQM developments and presents a universal approach to translation quality measurement across three sample size ranges. It also explains why Statistical Quality Control should be used for very small sample sizes, starting from a single sentence. |
| title | The Multi-Range Theory of Translation Quality Measurement: MQM scoring models and Statistical Quality Control |
| topic | Computation and Language Applications |
| url | https://arxiv.org/abs/2405.16969 |