IIITH-BUT system for IWSLT 2025 low-resource Bhojpuri to Hindi speech translation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Akkiraju, Bhavana, Pothula, Aishwarya, Kesiraju, Santosh, Vuppala, Anil Kumar
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913877607841792
author Akkiraju, Bhavana
Pothula, Aishwarya
Kesiraju, Santosh
Vuppala, Anil Kumar
author_facet Akkiraju, Bhavana
Pothula, Aishwarya
Kesiraju, Santosh
Vuppala, Anil Kumar
contents This paper presents the submission of IIITH-BUT to the IWSLT 2025 shared task on speech translation for the low-resource Bhojpuri-Hindi language pair. We explored the impact of hyperparameter optimisation and data augmentation techniques on the performance of the SeamlessM4T model fine-tuned for this specific task. We systematically investigated a range of hyperparameters including learning rate schedules, number of update steps, warm-up steps, label smoothing, and batch sizes; and report their effect on translation quality. To address data scarcity, we applied speed perturbation and SpecAugment and studied their effect on translation quality. We also examined the use of cross-lingual signal through joint training with Marathi and Bhojpuri speech data. Our experiments reveal that careful selection of hyperparameters and the application of simple yet effective augmentation techniques significantly improve performance in low-resource settings. We also analysed the translation hypotheses to understand various kinds of errors that impacted the translation quality in terms of BLEU.
format Preprint
id arxiv_https___arxiv_org_abs_2506_04714
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle IIITH-BUT system for IWSLT 2025 low-resource Bhojpuri to Hindi speech translation
Akkiraju, Bhavana
Pothula, Aishwarya
Kesiraju, Santosh
Vuppala, Anil Kumar
Computation and Language
Audio and Speech Processing
This paper presents the submission of IIITH-BUT to the IWSLT 2025 shared task on speech translation for the low-resource Bhojpuri-Hindi language pair. We explored the impact of hyperparameter optimisation and data augmentation techniques on the performance of the SeamlessM4T model fine-tuned for this specific task. We systematically investigated a range of hyperparameters including learning rate schedules, number of update steps, warm-up steps, label smoothing, and batch sizes; and report their effect on translation quality. To address data scarcity, we applied speed perturbation and SpecAugment and studied their effect on translation quality. We also examined the use of cross-lingual signal through joint training with Marathi and Bhojpuri speech data. Our experiments reveal that careful selection of hyperparameters and the application of simple yet effective augmentation techniques significantly improve performance in low-resource settings. We also analysed the translation hypotheses to understand various kinds of errors that impacted the translation quality in terms of BLEU.
title IIITH-BUT system for IWSLT 2025 low-resource Bhojpuri to Hindi speech translation
topic Computation and Language
Audio and Speech Processing
url https://arxiv.org/abs/2506.04714