Translation or Recitation? Calibrating Evaluation Scores for Machine Translation of Extremely Low-Resource Languages
Fuente:
arXiv
Saved in:
| Main Authors: | Chen, Danlu, He, Ka Sing, Tian, Jiahe, Xiao, Chenghao, Wu, Zhaofeng, Berg-Kirkpatrick, Taylor, Shi, Freda |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
LogogramNLP: Comparing Visual and Textual Representations of Ancient Logographic Writing Systems for NLP
by: Chen, Danlu, et al.
Published: (2024)
by: Chen, Danlu, et al.
Published: (2024)
Pivot Language for Low-Resource Machine Translation
by: Talwar, Abhimanyu, et al.
Published: (2025)
by: Talwar, Abhimanyu, et al.
Published: (2025)
Evaluating Extremely Low-Resource Machine Translation: A Comparative Study of ChrF++ and BLEU Metrics
by: Kumar, Sanjeev, et al.
Published: (2026)
by: Kumar, Sanjeev, et al.
Published: (2026)
Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Books
by: Zhang, Chen, et al.
Published: (2025)
by: Zhang, Chen, et al.
Published: (2025)
Machine Translation Advancements of Low-Resource Indian Languages by Transfer Learning
by: Wei, Bin, et al.
Published: (2024)
by: Wei, Bin, et al.
Published: (2024)
A Gamified Evaluation and Recruitment Platform for Low Resource Language Machine Translation Systems
by: Catalan, Carlos Rafael
Published: (2025)
by: Catalan, Carlos Rafael
Published: (2025)
Dialectal and Low-Resource Machine Translation for Aromanian
by: Jerpelea, Alexandru-Iulius, et al.
Published: (2024)
by: Jerpelea, Alexandru-Iulius, et al.
Published: (2024)
LLM-Assisted Rule Based Machine Translation for Low/No-Resource Languages
by: Coleman, Jared, et al.
Published: (2024)
by: Coleman, Jared, et al.
Published: (2024)
Is Small Language Model the Silver Bullet to Low-Resource Languages Machine Translation?
by: Song, Yewei, et al.
Published: (2025)
by: Song, Yewei, et al.
Published: (2025)
Toxicity-Aware Few-Shot Prompting for Low-Resource Singlish Translation
by: Ge, Ziyu, et al.
Published: (2025)
by: Ge, Ziyu, et al.
Published: (2025)
Readability $\ne$ Learnability: Rethinking the Role of Simplicity in Training Small Language Models
by: Lee, Ivan, et al.
Published: (2025)
by: Lee, Ivan, et al.
Published: (2025)
Reflective Translation: Improving Low-Resource Machine Translation via Structured Self-Reflection
by: Cheng, Nicholas
Published: (2026)
by: Cheng, Nicholas
Published: (2026)
Beyond Many-Shot Translation: Scaling In-Context Demonstrations For Low-Resource Machine Translation
by: Salim, Luis Frentzen, et al.
Published: (2026)
by: Salim, Luis Frentzen, et al.
Published: (2026)
Learning Language Structures through Grounding
by: Shi, Freda
Published: (2024)
by: Shi, Freda
Published: (2024)
Neural Machine Translation for Coptic-French: Strategies for Low-Resource Ancient Languages
by: Chaoui, Nasma, et al.
Published: (2025)
by: Chaoui, Nasma, et al.
Published: (2025)
Predicting Machine Translation Performance on Low-Resource Languages: The Role of Domain Similarity
by: Khiu, Eric, et al.
Published: (2024)
by: Khiu, Eric, et al.
Published: (2024)
Open Language Data Initiative: Advancing Low-Resource Machine Translation for Karakalpak
by: Mamasaidov, Mukhammadsaid, et al.
Published: (2024)
by: Mamasaidov, Mukhammadsaid, et al.
Published: (2024)
Generative-Adversarial Networks for Low-Resource Language Data Augmentation in Machine Translation
by: Zeng, Linda
Published: (2024)
by: Zeng, Linda
Published: (2024)
Misgendering and Assuming Gender in Machine Translation when Working with Low-Resource Languages
by: Ghosh, Sourojit, et al.
Published: (2024)
by: Ghosh, Sourojit, et al.
Published: (2024)
Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks
by: Wu, Zhaofeng, et al.
Published: (2023)
by: Wu, Zhaofeng, et al.
Published: (2023)
PEAR: Pairwise Evaluation for Automatic Relative Scoring in Machine Translation
by: Proietti, Lorenzo, et al.
Published: (2026)
by: Proietti, Lorenzo, et al.
Published: (2026)
To Translate or Not to Translate: A Systematic Investigation of Translation-Based Cross-Lingual Transfer to Low-Resource Languages
by: Ebing, Benedikt, et al.
Published: (2023)
by: Ebing, Benedikt, et al.
Published: (2023)
Enhancing Neural Machine Translation of Low-Resource Languages: Corpus Development, Human Evaluation and Explainable AI Architectures
by: Lankford, Séamus
Published: (2024)
by: Lankford, Séamus
Published: (2024)
Compensating for Data with Reasoning: Low-Resource Machine Translation with LLMs
by: Frontull, Samuel, et al.
Published: (2025)
by: Frontull, Samuel, et al.
Published: (2025)
Machine Translation Hallucination Detection for Low and High Resource Languages using Large Language Models
by: Benkirane, Kenza, et al.
Published: (2024)
by: Benkirane, Kenza, et al.
Published: (2024)
Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu
by: Pei, Renhao, et al.
Published: (2025)
by: Pei, Renhao, et al.
Published: (2025)
An Empirical Study of Many-Shot In-Context Learning for Machine Translation of Low-Resource Languages
by: Lu, Yinhan, et al.
Published: (2026)
by: Lu, Yinhan, et al.
Published: (2026)
ChakmaNMT: Machine Translation for a Low-Resource and Endangered Language via Transliteration
by: Chakma, Aunabil, et al.
Published: (2024)
by: Chakma, Aunabil, et al.
Published: (2024)
Massively Multilingual Text Translation For Low-Resource Languages
by: Zhou, Zhong
Published: (2024)
by: Zhou, Zhong
Published: (2024)
Transcending Language Boundaries: Harnessing LLMs for Low-Resource Language Translation
by: Shu, Peng, et al.
Published: (2024)
by: Shu, Peng, et al.
Published: (2024)
Expanding FLORES+ Benchmark for more Low-Resource Settings: Portuguese-Emakhuwa Machine Translation Evaluation
by: Ali, Felermino D. M. Antonio, et al.
Published: (2024)
by: Ali, Felermino D. M. Antonio, et al.
Published: (2024)
Multi-Dimensional Machine Translation Evaluation: Model Evaluation and Resource for Korean
by: Park, Dojun, et al.
Published: (2024)
by: Park, Dojun, et al.
Published: (2024)
NusaMT-7B: Machine Translation for Low-Resource Indonesian Languages with Large Language Models
by: Tan, William, et al.
Published: (2024)
by: Tan, William, et al.
Published: (2024)
Evaluating LLM-Based Translation of a Low-Resource Technical Language: The Medical and Philosophical Greek of Galen
by: Zainaldin, James L., et al.
Published: (2026)
by: Zainaldin, James L., et al.
Published: (2026)
The Effectiveness of Morphology-aware Segmentation in Low-Resource Neural Machine Translation
by: Sälevä, Jonne, et al.
Published: (2021)
by: Sälevä, Jonne, et al.
Published: (2021)
From LLM to NMT: Advancing Low-Resource Machine Translation with Claude
by: Enis, Maxim, et al.
Published: (2024)
by: Enis, Maxim, et al.
Published: (2024)
Beyond MLE: Investigating SEARNN for Low-Resourced Neural Machine Translation
by: Emezue, Chris
Published: (2024)
by: Emezue, Chris
Published: (2024)
Pointer-Generator Networks for Low-Resource Machine Translation: Don't Copy That!
by: Bafna, Niyati, et al.
Published: (2024)
by: Bafna, Niyati, et al.
Published: (2024)
Domain-Specific Quality Estimation for Machine Translation in Low-Resource Scenarios
by: Gurav, Namrata Patil, et al.
Published: (2026)
by: Gurav, Namrata Patil, et al.
Published: (2026)
Low-Resource Machine Translation through the Lens of Personalized Federated Learning
by: Moskvoretskii, Viktor, et al.
Published: (2024)
by: Moskvoretskii, Viktor, et al.
Published: (2024)
Similar Items
-
LogogramNLP: Comparing Visual and Textual Representations of Ancient Logographic Writing Systems for NLP
by: Chen, Danlu, et al.
Published: (2024) -
Pivot Language for Low-Resource Machine Translation
by: Talwar, Abhimanyu, et al.
Published: (2025) -
Evaluating Extremely Low-Resource Machine Translation: A Comparative Study of ChrF++ and BLEU Metrics
by: Kumar, Sanjeev, et al.
Published: (2026) -
Read it in Two Steps: Translating Extremely Low-Resource Languages with Code-Augmented Grammar Books
by: Zhang, Chen, et al.
Published: (2025) -
Machine Translation Advancements of Low-Resource Indian Languages by Transfer Learning
by: Wei, Bin, et al.
Published: (2024)