Sound Check: Auditing Audio Datasets

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Agnew, William, Barnett, Julia, Chu, Annie, Hong, Rachel, Feffer, Michael, Netzorg, Robin, Jiang, Harry H., Awumey, Ezra, Das, Sauvik
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914975998541824
author Agnew, William
Barnett, Julia
Chu, Annie
Hong, Rachel
Feffer, Michael
Netzorg, Robin
Jiang, Harry H.
Awumey, Ezra
Das, Sauvik
author_facet Agnew, William
Barnett, Julia
Chu, Annie
Hong, Rachel
Feffer, Michael
Netzorg, Robin
Jiang, Harry H.
Awumey, Ezra
Das, Sauvik
contents Generative audio models are rapidly advancing in both capabilities and public utilization -- several powerful generative audio models have readily available open weights, and some tech companies have released high quality generative audio products. Yet, while prior work has enumerated many ethical issues stemming from the data on which generative visual and textual models have been trained, we have little understanding of similar issues with generative audio datasets, including those related to bias, toxicity, and intellectual property. To bridge this gap, we conducted a literature review of hundreds of audio datasets and selected seven of the most prominent to audit in more detail. We found that these datasets are biased against women, contain toxic stereotypes about marginalized communities, and contain significant amounts of copyrighted work. To enable artists to see if they are in popular audio datasets and facilitate exploration of the contents of these datasets, we developed a web tool audio datasets exploration tool at https://audio-audit.vercel.app.
format Preprint
id arxiv_https___arxiv_org_abs_2410_13114
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Sound Check: Auditing Audio Datasets
Agnew, William
Barnett, Julia
Chu, Annie
Hong, Rachel
Feffer, Michael
Netzorg, Robin
Jiang, Harry H.
Awumey, Ezra
Das, Sauvik
Sound
Artificial Intelligence
Computers and Society
Audio and Speech Processing
Generative audio models are rapidly advancing in both capabilities and public utilization -- several powerful generative audio models have readily available open weights, and some tech companies have released high quality generative audio products. Yet, while prior work has enumerated many ethical issues stemming from the data on which generative visual and textual models have been trained, we have little understanding of similar issues with generative audio datasets, including those related to bias, toxicity, and intellectual property. To bridge this gap, we conducted a literature review of hundreds of audio datasets and selected seven of the most prominent to audit in more detail. We found that these datasets are biased against women, contain toxic stereotypes about marginalized communities, and contain significant amounts of copyrighted work. To enable artists to see if they are in popular audio datasets and facilitate exploration of the contents of these datasets, we developed a web tool audio datasets exploration tool at https://audio-audit.vercel.app.
title Sound Check: Auditing Audio Datasets
topic Sound
Artificial Intelligence
Computers and Society
Audio and Speech Processing
url https://arxiv.org/abs/2410.13114