Saved in:
Bibliographic Details
Main Authors: Saadi, Hossain Shaikh, Bui, Minh Duc, Sanz-Guerrero, Mario, von der Wense, Katharina
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.22490
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • This paper presents the JGU Mainz submission to the WMT25 Shared Task on LLMs with Limited Resources for Slavic Languages: Machine Translation and Question Answering, focusing on Ukrainian, Upper Sorbian, and Lower Sorbian. For each language, we jointly fine-tune a Qwen2.5-3B-Instruct model for both tasks with parameter-efficient finetuning. Our pipeline integrates additional translation and multiple-choice question answering (QA) data. For Ukrainian QA, we further use retrieval-augmented generation. We also apply ensembling for QA in Upper and Lower Sorbian. Experiments show that our models outperform the baseline on both tasks.