The first Cadenza challenges: using machine learning competitions to improve music for listeners with a hearing loss

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Dabike, Gerardo Roa, Akeroyd, Michael A., Bannister, Scott, Barker, Jon P., Cox, Trevor J., Fazenda, Bruno, Firth, Jennifer, Graetzer, Simone, Greasley, Alinka, Vos, Rebecca R., Whitmer, William M.
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866929491617513472
author Dabike, Gerardo Roa
Akeroyd, Michael A.
Bannister, Scott
Barker, Jon P.
Cox, Trevor J.
Fazenda, Bruno
Firth, Jennifer
Graetzer, Simone
Greasley, Alinka
Vos, Rebecca R.
Whitmer, William M.
author_facet Dabike, Gerardo Roa
Akeroyd, Michael A.
Bannister, Scott
Barker, Jon P.
Cox, Trevor J.
Fazenda, Bruno
Firth, Jennifer
Graetzer, Simone
Greasley, Alinka
Vos, Rebecca R.
Whitmer, William M.
contents It is well established that listening to music is an issue for those with hearing loss, and hearing aids are not a universal solution. How can machine learning be used to address this? This paper details the first application of the open challenge methodology to use machine learning to improve audio quality of music for those with hearing loss. The first challenge was a stand-alone competition (CAD1) and had 9 entrants. The second was an 2024 ICASSP grand challenge (ICASSP24) and attracted 17 entrants. The challenge tasks concerned demixing and remixing pop/rock music to allow a personalised rebalancing of the instruments in the mix, along with amplification to correct for raised hearing thresholds. The software baselines provided for entrants to build upon used two state-of-the-art demix algorithms: Hybrid Demucs and Open-Unmix. Evaluation of systems was done using the objective metric HAAQI, the Hearing-Aid Audio Quality Index. No entrants improved on the best baseline in CAD1 because there was insufficient room for improvement. Consequently, for ICASSP24 the scenario was made more difficult by using loudspeaker reproduction and specified gains to be applied before remixing. This also made the scenario more useful for listening through hearing aids. 9 entrants scored better than the the best ICASSP24 baseline. Most entrants used a refined version of Hybrid Demucs and NAL-R amplification. The highest scoring system combined the outputs of several demixing algorithms in an ensemble approach. These challenges are now open benchmarks for future research with the software and data being freely available.
format Preprint
id arxiv_https___arxiv_org_abs_2409_05095
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The first Cadenza challenges: using machine learning competitions to improve music for listeners with a hearing loss
Dabike, Gerardo Roa
Akeroyd, Michael A.
Bannister, Scott
Barker, Jon P.
Cox, Trevor J.
Fazenda, Bruno
Firth, Jennifer
Graetzer, Simone
Greasley, Alinka
Vos, Rebecca R.
Whitmer, William M.
Sound
Machine Learning
Audio and Speech Processing
It is well established that listening to music is an issue for those with hearing loss, and hearing aids are not a universal solution. How can machine learning be used to address this? This paper details the first application of the open challenge methodology to use machine learning to improve audio quality of music for those with hearing loss. The first challenge was a stand-alone competition (CAD1) and had 9 entrants. The second was an 2024 ICASSP grand challenge (ICASSP24) and attracted 17 entrants. The challenge tasks concerned demixing and remixing pop/rock music to allow a personalised rebalancing of the instruments in the mix, along with amplification to correct for raised hearing thresholds. The software baselines provided for entrants to build upon used two state-of-the-art demix algorithms: Hybrid Demucs and Open-Unmix. Evaluation of systems was done using the objective metric HAAQI, the Hearing-Aid Audio Quality Index. No entrants improved on the best baseline in CAD1 because there was insufficient room for improvement. Consequently, for ICASSP24 the scenario was made more difficult by using loudspeaker reproduction and specified gains to be applied before remixing. This also made the scenario more useful for listening through hearing aids. 9 entrants scored better than the the best ICASSP24 baseline. Most entrants used a refined version of Hybrid Demucs and NAL-R amplification. The highest scoring system combined the outputs of several demixing algorithms in an ensemble approach. These challenges are now open benchmarks for future research with the software and data being freely available.
title The first Cadenza challenges: using machine learning competitions to improve music for listeners with a hearing loss
topic Sound
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2409.05095