Preliminary Ranking of WMT25 General Machine Translation Systems
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911118459404288 |
|---|---|
| author | Kocmi, Tom Avramidis, Eleftherios Bawden, Rachel Bojar, Ondřej Dranch, Konstantin Dvorkovich, Anton Dukanov, Sergey Fedorova, Natalia Fishel, Mark Freitag, Markus Gowda, Thamme Grundkiewicz, Roman Haddow, Barry Karpinska, Marzena Koehn, Philipp Lakougna, Howard Lundin, Jessica Murray, Kenton Nagata, Masaaki Perrella, Stefano Proietti, Lorenzo Popel, Martin Popović, Maja Riley, Parker Shmatova, Mariya Steingrímsson, Steinþór Yankovskaya, Lisa Zouhar, Vilém |
| author_facet | Kocmi, Tom Avramidis, Eleftherios Bawden, Rachel Bojar, Ondřej Dranch, Konstantin Dvorkovich, Anton Dukanov, Sergey Fedorova, Natalia Fishel, Mark Freitag, Markus Gowda, Thamme Grundkiewicz, Roman Haddow, Barry Karpinska, Marzena Koehn, Philipp Lakougna, Howard Lundin, Jessica Murray, Kenton Nagata, Masaaki Perrella, Stefano Proietti, Lorenzo Popel, Martin Popović, Maja Riley, Parker Shmatova, Mariya Steingrímsson, Steinþór Yankovskaya, Lisa Zouhar, Vilém |
| contents | We present the preliminary rankings of machine translation (MT) systems submitted to the WMT25 General Machine Translation Shared Task, as determined by automatic evaluation metrics. Because these rankings are derived from automatic evaluation, they may exhibit a bias toward systems that employ re-ranking techniques, such as Quality Estimation or Minimum Bayes Risk decoding. The official WMT25 ranking will be based on human evaluation, which is more reliable and will supersede these results. The official WMT25 ranking will be based on human evaluation, which is more reliable and will supersede these results. The purpose of releasing these findings now is to assist task participants with their system description papers; not to provide final findings. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_14909 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Preliminary Ranking of WMT25 General Machine Translation Systems Kocmi, Tom Avramidis, Eleftherios Bawden, Rachel Bojar, Ondřej Dranch, Konstantin Dvorkovich, Anton Dukanov, Sergey Fedorova, Natalia Fishel, Mark Freitag, Markus Gowda, Thamme Grundkiewicz, Roman Haddow, Barry Karpinska, Marzena Koehn, Philipp Lakougna, Howard Lundin, Jessica Murray, Kenton Nagata, Masaaki Perrella, Stefano Proietti, Lorenzo Popel, Martin Popović, Maja Riley, Parker Shmatova, Mariya Steingrímsson, Steinþór Yankovskaya, Lisa Zouhar, Vilém Computation and Language We present the preliminary rankings of machine translation (MT) systems submitted to the WMT25 General Machine Translation Shared Task, as determined by automatic evaluation metrics. Because these rankings are derived from automatic evaluation, they may exhibit a bias toward systems that employ re-ranking techniques, such as Quality Estimation or Minimum Bayes Risk decoding. The official WMT25 ranking will be based on human evaluation, which is more reliable and will supersede these results. The official WMT25 ranking will be based on human evaluation, which is more reliable and will supersede these results. The purpose of releasing these findings now is to assist task participants with their system description papers; not to provide final findings. |
| title | Preliminary Ranking of WMT25 General Machine Translation Systems |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2508.14909 |