Preliminary WMT24 Ranking of General MT Systems and LLMs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kocmi, Tom, Avramidis, Eleftherios, Bawden, Rachel, Bojar, Ondrej, Dvorkovich, Anton, Federmann, Christian, Fishel, Mark, Freitag, Markus, Gowda, Thamme, Grundkiewicz, Roman, Haddow, Barry, Karpinska, Marzena, Koehn, Philipp, Marie, Benjamin, Murray, Kenton, Nagata, Masaaki, Popel, Martin, Popovic, Maja, Shmatova, Mariya, Steingrímsson, Steinþór, Zouhar, Vilém
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911971082764288
author Kocmi, Tom
Avramidis, Eleftherios
Bawden, Rachel
Bojar, Ondrej
Dvorkovich, Anton
Federmann, Christian
Fishel, Mark
Freitag, Markus
Gowda, Thamme
Grundkiewicz, Roman
Haddow, Barry
Karpinska, Marzena
Koehn, Philipp
Marie, Benjamin
Murray, Kenton
Nagata, Masaaki
Popel, Martin
Popovic, Maja
Shmatova, Mariya
Steingrímsson, Steinþór
Zouhar, Vilém
author_facet Kocmi, Tom
Avramidis, Eleftherios
Bawden, Rachel
Bojar, Ondrej
Dvorkovich, Anton
Federmann, Christian
Fishel, Mark
Freitag, Markus
Gowda, Thamme
Grundkiewicz, Roman
Haddow, Barry
Karpinska, Marzena
Koehn, Philipp
Marie, Benjamin
Murray, Kenton
Nagata, Masaaki
Popel, Martin
Popovic, Maja
Shmatova, Mariya
Steingrímsson, Steinþór
Zouhar, Vilém
contents This is the preliminary ranking of WMT24 General MT systems based on automatic metrics. The official ranking will be a human evaluation, which is superior to the automatic ranking and supersedes it. The purpose of this report is not to interpret any findings but only provide preliminary results to the participants of the General MT task that may be useful during the writing of the system submission.
format Preprint
id arxiv_https___arxiv_org_abs_2407_19884
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Preliminary WMT24 Ranking of General MT Systems and LLMs
Kocmi, Tom
Avramidis, Eleftherios
Bawden, Rachel
Bojar, Ondrej
Dvorkovich, Anton
Federmann, Christian
Fishel, Mark
Freitag, Markus
Gowda, Thamme
Grundkiewicz, Roman
Haddow, Barry
Karpinska, Marzena
Koehn, Philipp
Marie, Benjamin
Murray, Kenton
Nagata, Masaaki
Popel, Martin
Popovic, Maja
Shmatova, Mariya
Steingrímsson, Steinþór
Zouhar, Vilém
Computation and Language
This is the preliminary ranking of WMT24 General MT systems based on automatic metrics. The official ranking will be a human evaluation, which is superior to the automatic ranking and supersedes it. The purpose of this report is not to interpret any findings but only provide preliminary results to the participants of the General MT task that may be useful during the writing of the system submission.
title Preliminary WMT24 Ranking of General MT Systems and LLMs
topic Computation and Language
url https://arxiv.org/abs/2407.19884