Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2405.10741 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909206015115264 |
|---|---|
| author | Gaido, Marco Papi, Sara Negri, Matteo Cettolo, Mauro Bentivogli, Luisa |
| author_facet | Gaido, Marco Papi, Sara Negri, Matteo Cettolo, Mauro Bentivogli, Luisa |
| contents | Subtitling plays a crucial role in enhancing the accessibility of audiovisual content and encompasses three primary subtasks: translating spoken dialogue, segmenting translations into concise textual units, and estimating timestamps that govern their on-screen duration. Past attempts to automate this process rely, to varying degrees, on automatic transcripts, employed diversely for the three subtasks. In response to the acknowledged limitations associated with this reliance on transcripts, recent research has shifted towards transcription-free solutions for translation and segmentation, leaving the direct generation of timestamps as uncharted territory. To fill this gap, we introduce the first direct model capable of producing automatic subtitles, entirely eliminating any dependence on intermediate transcripts also for timestamp prediction. Experimental results, backed by manual evaluation, showcase our solution's new state-of-the-art performance across multiple language pairs and diverse conditions. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2405_10741 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SBAAM! Eliminating Transcript Dependency in Automatic Subtitling Gaido, Marco Papi, Sara Negri, Matteo Cettolo, Mauro Bentivogli, Luisa Computation and Language Subtitling plays a crucial role in enhancing the accessibility of audiovisual content and encompasses three primary subtasks: translating spoken dialogue, segmenting translations into concise textual units, and estimating timestamps that govern their on-screen duration. Past attempts to automate this process rely, to varying degrees, on automatic transcripts, employed diversely for the three subtasks. In response to the acknowledged limitations associated with this reliance on transcripts, recent research has shifted towards transcription-free solutions for translation and segmentation, leaving the direct generation of timestamps as uncharted territory. To fill this gap, we introduce the first direct model capable of producing automatic subtitles, entirely eliminating any dependence on intermediate transcripts also for timestamp prediction. Experimental results, backed by manual evaluation, showcase our solution's new state-of-the-art performance across multiple language pairs and diverse conditions. |
| title | SBAAM! Eliminating Transcript Dependency in Automatic Subtitling |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2405.10741 |