Reading Between the Waves: Robust Topic Segmentation Using Inter-Sentence Audio Features
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910014219747328 |
|---|---|
| author | Freisinger, Steffen Seeberger, Philipp Bocklet, Tobias Riedhammer, Korbinian |
| author_facet | Freisinger, Steffen Seeberger, Philipp Bocklet, Tobias Riedhammer, Korbinian |
| contents | Spoken content, such as online videos and podcasts, often spans multiple topics, which makes automatic topic segmentation essential for user navigation and downstream applications. However, current methods do not fully leverage acoustic features, leaving room for improvement. We propose a multi-modal approach that fine-tunes both a text encoder and a Siamese audio encoder, capturing acoustic cues around sentence boundaries. Experiments on a large-scale dataset of YouTube videos show substantial gains over text-only and multi-modal baselines. Our model also proves more resilient to ASR noise and outperforms a larger text-only baseline on three additional datasets in Portuguese, German, and English, underscoring the value of learned acoustic features for robust topic segmentation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_06647 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Reading Between the Waves: Robust Topic Segmentation Using Inter-Sentence Audio Features Freisinger, Steffen Seeberger, Philipp Bocklet, Tobias Riedhammer, Korbinian Computation and Language Audio and Speech Processing I.2.7; H.3.1; I.5.4 Spoken content, such as online videos and podcasts, often spans multiple topics, which makes automatic topic segmentation essential for user navigation and downstream applications. However, current methods do not fully leverage acoustic features, leaving room for improvement. We propose a multi-modal approach that fine-tunes both a text encoder and a Siamese audio encoder, capturing acoustic cues around sentence boundaries. Experiments on a large-scale dataset of YouTube videos show substantial gains over text-only and multi-modal baselines. Our model also proves more resilient to ASR noise and outperforms a larger text-only baseline on three additional datasets in Portuguese, German, and English, underscoring the value of learned acoustic features for robust topic segmentation. |
| title | Reading Between the Waves: Robust Topic Segmentation Using Inter-Sentence Audio Features |
| topic | Computation and Language Audio and Speech Processing I.2.7; H.3.1; I.5.4 |
| url | https://arxiv.org/abs/2602.06647 |