Simultaneous Translation with Offline Speech and LLM Models in CUNI Submission to IWSLT 2025

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Macháček, Dominik, Polák, Peter
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866911015684276224
author Macháček, Dominik
Polák, Peter
author_facet Macháček, Dominik
Polák, Peter
contents This paper describes Charles University submission to the Simultaneous Speech Translation Task of the IWSLT 2025. We cover all four language pairs with a direct or cascade approach. The backbone of our systems is the offline Whisper speech model, which we use for both translation and transcription in simultaneous mode with the state-of-the-art simultaneous policy AlignAtt. We further improve the performance by prompting to inject in-domain terminology, and we accommodate context. Our cascaded systems further use EuroLLM for unbounded simultaneous translation. Compared to the Organizers' baseline, our systems improve by 2 BLEU points on Czech to English and 13-22 BLEU points on English to German, Chinese and Japanese on the development sets. Additionally, we also propose a new enhanced measure of speech recognition latency.
format Preprint
id arxiv_https___arxiv_org_abs_2506_17077
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Simultaneous Translation with Offline Speech and LLM Models in CUNI Submission to IWSLT 2025
Macháček, Dominik
Polák, Peter
Computation and Language
This paper describes Charles University submission to the Simultaneous Speech Translation Task of the IWSLT 2025. We cover all four language pairs with a direct or cascade approach. The backbone of our systems is the offline Whisper speech model, which we use for both translation and transcription in simultaneous mode with the state-of-the-art simultaneous policy AlignAtt. We further improve the performance by prompting to inject in-domain terminology, and we accommodate context. Our cascaded systems further use EuroLLM for unbounded simultaneous translation. Compared to the Organizers' baseline, our systems improve by 2 BLEU points on Czech to English and 13-22 BLEU points on English to German, Chinese and Japanese on the development sets. Additionally, we also propose a new enhanced measure of speech recognition latency.
title Simultaneous Translation with Offline Speech and LLM Models in CUNI Submission to IWSLT 2025
topic Computation and Language
url https://arxiv.org/abs/2506.17077