An automatic mixing speech enhancement system for multi-track audio

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Liu, Xiaojing, Ai, Hongwei, Reiss, Joshua D.
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917808990846976
author Liu, Xiaojing
Ai, Hongwei
Reiss, Joshua D.
author_facet Liu, Xiaojing
Ai, Hongwei
Reiss, Joshua D.
contents We propose a speech enhancement system for multitrack audio. The system will minimize auditory masking while allowing one to hear multiple simultaneous speakers. The system can be used in multiple communication scenarios e.g., teleconferencing, invoice gaming, and live streaming. The ITU-R BS.1387 Perceptual Evaluation of Audio Quality (PEAQ) model is used to evaluate the amount of masking in the audio signals. Different audio effects e.g., level balance, equalization, dynamic range compression, and spatialization are applied via an iterative Harmony searching algorithm that aims to minimize the masking. In the subjective listening test, the designed system can compete with mixes by professional sound engineers and outperforms mixes by existing auto-mixing systems.
format Preprint
id arxiv_https___arxiv_org_abs_2404_17821
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle An automatic mixing speech enhancement system for multi-track audio
Liu, Xiaojing
Ai, Hongwei
Reiss, Joshua D.
Sound
Multimedia
Audio and Speech Processing
We propose a speech enhancement system for multitrack audio. The system will minimize auditory masking while allowing one to hear multiple simultaneous speakers. The system can be used in multiple communication scenarios e.g., teleconferencing, invoice gaming, and live streaming. The ITU-R BS.1387 Perceptual Evaluation of Audio Quality (PEAQ) model is used to evaluate the amount of masking in the audio signals. Different audio effects e.g., level balance, equalization, dynamic range compression, and spatialization are applied via an iterative Harmony searching algorithm that aims to minimize the masking. In the subjective listening test, the designed system can compete with mixes by professional sound engineers and outperforms mixes by existing auto-mixing systems.
title An automatic mixing speech enhancement system for multi-track audio
topic Sound
Multimedia
Audio and Speech Processing
url https://arxiv.org/abs/2404.17821