Navigating Speech Recording Collections with AI-Generated Illustrations

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Håland, Sirina, Strøm, Trond Karlsen, Galuščáková, Petra
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918084926767104
author Håland, Sirina
Strøm, Trond Karlsen
Galuščáková, Petra
author_facet Håland, Sirina
Strøm, Trond Karlsen
Galuščáková, Petra
contents Although the amount of available spoken content is steadily increasing, extracting information and knowledge from speech recordings remains challenging. Beyond enhancing traditional information retrieval methods such as speech search and keyword spotting, novel approaches for navigating and searching spoken content need to be explored and developed. In this paper, we propose a novel navigational method for speech archives that leverages recent advances in language and multimodal generative models. We demonstrate our approach with a Web application that organizes data into a structured format using interactive mind maps and image generation tools. The system is implemented using the TED-LIUM~3 dataset, which comprises over 2,000 speech transcripts and audio files of TED Talks. Initial user tests using a System Usability Scale (SUS) questionnaire indicate the application's potential to simplify the exploration of large speech collections.
format Preprint
id arxiv_https___arxiv_org_abs_2507_04182
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Navigating Speech Recording Collections with AI-Generated Illustrations
Håland, Sirina
Strøm, Trond Karlsen
Galuščáková, Petra
Information Retrieval
Computation and Language
Human-Computer Interaction
Sound
Audio and Speech Processing
Although the amount of available spoken content is steadily increasing, extracting information and knowledge from speech recordings remains challenging. Beyond enhancing traditional information retrieval methods such as speech search and keyword spotting, novel approaches for navigating and searching spoken content need to be explored and developed. In this paper, we propose a novel navigational method for speech archives that leverages recent advances in language and multimodal generative models. We demonstrate our approach with a Web application that organizes data into a structured format using interactive mind maps and image generation tools. The system is implemented using the TED-LIUM~3 dataset, which comprises over 2,000 speech transcripts and audio files of TED Talks. Initial user tests using a System Usability Scale (SUS) questionnaire indicate the application's potential to simplify the exploration of large speech collections.
title Navigating Speech Recording Collections with AI-Generated Illustrations
topic Information Retrieval
Computation and Language
Human-Computer Interaction
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2507.04182