A Framework for Synthetic Audio Conversations Generation using Large Language Models

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Kyaw, Kaung Myat, Chan, Jonathan Hoyin
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909676253216768
author Kyaw, Kaung Myat
Chan, Jonathan Hoyin
author_facet Kyaw, Kaung Myat
Chan, Jonathan Hoyin
contents In this paper, we introduce ConversaSynth, a framework designed to generate synthetic conversation audio using large language models (LLMs) with multiple persona settings. The framework first creates diverse and coherent text-based dialogues across various topics, which are then converted into audio using text-to-speech (TTS) systems. Our experiments demonstrate that ConversaSynth effectively generates highquality synthetic audio datasets, which can significantly enhance the training and evaluation of models for audio tagging, audio classification, and multi-speaker speech recognition. The results indicate that the synthetic datasets generated by ConversaSynth exhibit substantial diversity and realism, making them suitable for developing robust, adaptable audio-based AI systems.
format Preprint
id arxiv_https___arxiv_org_abs_2409_00946
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Framework for Synthetic Audio Conversations Generation using Large Language Models
Kyaw, Kaung Myat
Chan, Jonathan Hoyin
Sound
Artificial Intelligence
Audio and Speech Processing
In this paper, we introduce ConversaSynth, a framework designed to generate synthetic conversation audio using large language models (LLMs) with multiple persona settings. The framework first creates diverse and coherent text-based dialogues across various topics, which are then converted into audio using text-to-speech (TTS) systems. Our experiments demonstrate that ConversaSynth effectively generates highquality synthetic audio datasets, which can significantly enhance the training and evaluation of models for audio tagging, audio classification, and multi-speaker speech recognition. The results indicate that the synthetic datasets generated by ConversaSynth exhibit substantial diversity and realism, making them suitable for developing robust, adaptable audio-based AI systems.
title A Framework for Synthetic Audio Conversations Generation using Large Language Models
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2409.00946